2023-07-23 23:05:50,786 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-23 23:05:51,039 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4 2023-07-23 23:05:51,040 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-23 23:05:51,040 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-23 23:05:51,086 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-23 23:05:51,379 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-23 23:05:51,380 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/cluster_115860c6-be70-9d94-b4d7-cb76015f80b3, deleteOnExit=true 2023-07-23 23:05:51,380 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-23 23:05:51,381 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/test.cache.data in system properties and HBase conf 2023-07-23 23:05:51,382 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/hadoop.tmp.dir in system properties and HBase conf 2023-07-23 23:05:51,382 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/hadoop.log.dir in system properties and HBase conf 2023-07-23 23:05:51,383 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-23 23:05:51,383 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-23 23:05:51,384 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-23 23:05:51,808 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-23 23:05:51,812 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-23 23:05:51,813 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-23 23:05:51,813 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-23 23:05:51,813 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 23:05:51,814 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-23 23:05:51,814 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-23 23:05:51,815 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 23:05:51,815 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 23:05:51,815 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-23 23:05:51,816 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/nfs.dump.dir in system properties and HBase conf 2023-07-23 23:05:51,816 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/java.io.tmpdir in system properties and HBase conf 2023-07-23 23:05:51,817 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 23:05:51,817 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-23 23:05:51,818 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-23 23:05:52,454 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-23 23:05:52,459 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-23 23:05:52,850 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-23 23:05:53,082 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-23 23:05:53,097 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 23:05:53,141 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 23:05:53,177 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/java.io.tmpdir/Jetty_localhost_33965_hdfs____.pgim0u/webapp 2023-07-23 23:05:53,336 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33965 2023-07-23 23:05:53,382 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-23 23:05:53,382 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-23 23:05:53,902 WARN [Listener at localhost/40459] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 23:05:54,030 WARN [Listener at localhost/40459] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-23 23:05:54,063 WARN [Listener at localhost/40459] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 23:05:54,074 INFO [Listener at localhost/40459] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 23:05:54,082 INFO [Listener at localhost/40459] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/java.io.tmpdir/Jetty_localhost_35349_datanode____h956pp/webapp 2023-07-23 23:05:54,214 INFO [Listener at localhost/40459] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35349 2023-07-23 23:05:54,774 WARN [Listener at localhost/41497] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 23:05:54,801 WARN [Listener at localhost/41497] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-23 23:05:54,806 WARN [Listener at localhost/41497] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 23:05:54,808 INFO [Listener at localhost/41497] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 23:05:54,818 INFO [Listener at localhost/41497] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/java.io.tmpdir/Jetty_localhost_41637_datanode____o7in6s/webapp 2023-07-23 23:05:54,955 INFO [Listener at localhost/41497] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41637 2023-07-23 23:05:54,990 WARN [Listener at localhost/42453] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 23:05:55,105 WARN [Listener at localhost/42453] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-23 23:05:55,108 WARN [Listener at localhost/42453] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 23:05:55,110 INFO [Listener at localhost/42453] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 23:05:55,118 INFO [Listener at localhost/42453] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/java.io.tmpdir/Jetty_localhost_44471_datanode____fprddh/webapp 2023-07-23 23:05:55,277 INFO [Listener at localhost/42453] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44471 2023-07-23 23:05:55,300 WARN [Listener at localhost/34569] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-23 23:05:55,683 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8b3c5da6555e2e7d: Processing first storage report for DS-502d90a2-5cdf-44e2-a171-489de05f99b6 from datanode b149ad14-6781-4322-9350-ee16fddd15cb 2023-07-23 23:05:55,684 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8b3c5da6555e2e7d: from storage DS-502d90a2-5cdf-44e2-a171-489de05f99b6 node DatanodeRegistration(127.0.0.1:35261, datanodeUuid=b149ad14-6781-4322-9350-ee16fddd15cb, infoPort=36627, infoSecurePort=0, ipcPort=41497, storageInfo=lv=-57;cid=testClusterID;nsid=793955756;c=1690153552554), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-23 23:05:55,685 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3ee529ade54a20ad: Processing first storage report for DS-33db6f42-c4ec-465a-83a8-8f56cb0fbb0b from datanode f4d1b812-659a-4696-af8c-bf72bca876e7 2023-07-23 23:05:55,685 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3ee529ade54a20ad: from storage DS-33db6f42-c4ec-465a-83a8-8f56cb0fbb0b node DatanodeRegistration(127.0.0.1:37469, datanodeUuid=f4d1b812-659a-4696-af8c-bf72bca876e7, infoPort=36683, infoSecurePort=0, ipcPort=34569, storageInfo=lv=-57;cid=testClusterID;nsid=793955756;c=1690153552554), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 23:05:55,685 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc6b931bf5ba4a8e: Processing first storage report for DS-cae23318-a657-4c1d-ac16-e239e44863df from datanode 7eba946d-5bd8-4385-98a8-2b41808e7b9b 2023-07-23 23:05:55,685 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc6b931bf5ba4a8e: from storage DS-cae23318-a657-4c1d-ac16-e239e44863df node DatanodeRegistration(127.0.0.1:41499, datanodeUuid=7eba946d-5bd8-4385-98a8-2b41808e7b9b, infoPort=32827, infoSecurePort=0, ipcPort=42453, storageInfo=lv=-57;cid=testClusterID;nsid=793955756;c=1690153552554), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 23:05:55,686 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8b3c5da6555e2e7d: Processing first storage report for DS-24256b48-f3c9-4178-af7e-8058d2be282f from datanode b149ad14-6781-4322-9350-ee16fddd15cb 2023-07-23 23:05:55,686 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8b3c5da6555e2e7d: from storage DS-24256b48-f3c9-4178-af7e-8058d2be282f node DatanodeRegistration(127.0.0.1:35261, datanodeUuid=b149ad14-6781-4322-9350-ee16fddd15cb, infoPort=36627, infoSecurePort=0, ipcPort=41497, storageInfo=lv=-57;cid=testClusterID;nsid=793955756;c=1690153552554), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 23:05:55,686 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3ee529ade54a20ad: Processing first storage report for DS-9b8246b7-8174-4dfd-9d28-eab9a2bc980f from datanode f4d1b812-659a-4696-af8c-bf72bca876e7 2023-07-23 23:05:55,686 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3ee529ade54a20ad: from storage DS-9b8246b7-8174-4dfd-9d28-eab9a2bc980f node DatanodeRegistration(127.0.0.1:37469, datanodeUuid=f4d1b812-659a-4696-af8c-bf72bca876e7, infoPort=36683, infoSecurePort=0, ipcPort=34569, storageInfo=lv=-57;cid=testClusterID;nsid=793955756;c=1690153552554), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-23 23:05:55,686 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc6b931bf5ba4a8e: Processing first storage report for DS-110608c0-9955-4448-9345-1af3cc784652 from datanode 7eba946d-5bd8-4385-98a8-2b41808e7b9b 2023-07-23 23:05:55,687 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc6b931bf5ba4a8e: from storage DS-110608c0-9955-4448-9345-1af3cc784652 node DatanodeRegistration(127.0.0.1:41499, datanodeUuid=7eba946d-5bd8-4385-98a8-2b41808e7b9b, infoPort=32827, infoSecurePort=0, ipcPort=42453, storageInfo=lv=-57;cid=testClusterID;nsid=793955756;c=1690153552554), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-23 23:05:55,958 DEBUG [Listener at localhost/34569] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4 2023-07-23 23:05:56,066 INFO [Listener at localhost/34569] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/cluster_115860c6-be70-9d94-b4d7-cb76015f80b3/zookeeper_0, clientPort=58893, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/cluster_115860c6-be70-9d94-b4d7-cb76015f80b3/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/cluster_115860c6-be70-9d94-b4d7-cb76015f80b3/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-23 23:05:56,093 INFO [Listener at localhost/34569] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58893 2023-07-23 23:05:56,105 INFO [Listener at localhost/34569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 23:05:56,108 INFO [Listener at localhost/34569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 23:05:56,824 INFO [Listener at localhost/34569] util.FSUtils(471): Created version file at hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f with version=8 2023-07-23 23:05:56,825 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/hbase-staging 2023-07-23 23:05:57,210 INFO [Listener at localhost/34569] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-23 23:05:57,889 INFO [Listener at localhost/34569] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 23:05:57,939 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 23:05:57,940 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 23:05:57,940 INFO [Listener at localhost/34569] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 23:05:57,941 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 23:05:57,941 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 23:05:58,146 INFO [Listener at localhost/34569] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 23:05:58,253 DEBUG [Listener at localhost/34569] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-23 23:05:58,384 INFO [Listener at localhost/34569] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43049 2023-07-23 23:05:58,404 INFO [Listener at localhost/34569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 23:05:58,407 INFO [Listener at localhost/34569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 23:05:58,439 INFO [Listener at localhost/34569] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43049 connecting to ZooKeeper ensemble=127.0.0.1:58893 2023-07-23 23:05:58,519 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:430490x0, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 23:05:58,522 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:43049-0x101946f1b500000 connected 2023-07-23 23:05:58,572 DEBUG [Listener at localhost/34569] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 23:05:58,573 DEBUG [Listener at localhost/34569] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 23:05:58,593 DEBUG [Listener at localhost/34569] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 23:05:58,627 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43049 2023-07-23 23:05:58,628 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43049 2023-07-23 23:05:58,630 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43049 2023-07-23 23:05:58,644 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43049 2023-07-23 23:05:58,644 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43049 2023-07-23 23:05:58,654 INFO [Listener at localhost/34569] master.HMaster(444): hbase.rootdir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f, hbase.cluster.distributed=false 2023-07-23 23:05:58,743 INFO [Listener at localhost/34569] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 23:05:58,743 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 23:05:58,744 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 23:05:58,744 INFO [Listener at localhost/34569] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 23:05:58,744 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 23:05:58,744 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 23:05:58,751 INFO [Listener at localhost/34569] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 23:05:58,755 INFO [Listener at localhost/34569] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39259 2023-07-23 23:05:58,758 INFO [Listener at localhost/34569] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-23 23:05:58,770 INFO [Listener at localhost/34569] mob.MobFileCache(124): MobFileCache disabled 2023-07-23 23:05:58,772 INFO [Listener at localhost/34569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 23:05:58,775 INFO [Listener at localhost/34569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 23:05:58,777 INFO [Listener at localhost/34569] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39259 connecting to ZooKeeper ensemble=127.0.0.1:58893 2023-07-23 23:05:58,782 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:392590x0, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 23:05:58,783 DEBUG [Listener at localhost/34569] zookeeper.ZKUtil(164): regionserver:392590x0, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 23:05:58,787 DEBUG [Listener at localhost/34569] zookeeper.ZKUtil(164): regionserver:392590x0, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 23:05:58,787 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39259-0x101946f1b500001 connected 2023-07-23 23:05:58,788 DEBUG [Listener at localhost/34569] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 23:05:58,797 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39259 2023-07-23 23:05:58,798 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39259 2023-07-23 23:05:58,799 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39259 2023-07-23 23:05:58,800 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39259 2023-07-23 23:05:58,800 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39259 2023-07-23 23:05:58,820 INFO [Listener at localhost/34569] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 23:05:58,820 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 23:05:58,820 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 23:05:58,821 INFO [Listener at localhost/34569] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 23:05:58,821 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 23:05:58,822 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 23:05:58,822 INFO [Listener at localhost/34569] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 23:05:58,824 INFO [Listener at localhost/34569] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38881 2023-07-23 23:05:58,824 INFO [Listener at localhost/34569] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-23 23:05:58,825 INFO [Listener at localhost/34569] mob.MobFileCache(124): MobFileCache disabled 2023-07-23 23:05:58,826 INFO [Listener at localhost/34569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 23:05:58,829 INFO [Listener at localhost/34569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 23:05:58,832 INFO [Listener at localhost/34569] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38881 connecting to ZooKeeper ensemble=127.0.0.1:58893 2023-07-23 23:05:58,836 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:388810x0, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 23:05:58,839 DEBUG [Listener at localhost/34569] zookeeper.ZKUtil(164): regionserver:388810x0, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 23:05:58,843 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38881-0x101946f1b500002 connected 2023-07-23 23:05:58,843 DEBUG [Listener at localhost/34569] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 23:05:58,844 DEBUG [Listener at localhost/34569] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 23:05:58,844 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38881 2023-07-23 23:05:58,845 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38881 2023-07-23 23:05:58,846 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38881 2023-07-23 23:05:58,853 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38881 2023-07-23 23:05:58,853 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38881 2023-07-23 23:05:58,867 INFO [Listener at localhost/34569] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-23 23:05:58,867 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 23:05:58,867 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-23 23:05:58,867 INFO [Listener at localhost/34569] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-23 23:05:58,867 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-23 23:05:58,867 INFO [Listener at localhost/34569] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-23 23:05:58,868 INFO [Listener at localhost/34569] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-23 23:05:58,869 INFO [Listener at localhost/34569] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34863 2023-07-23 23:05:58,870 INFO [Listener at localhost/34569] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-23 23:05:58,871 INFO [Listener at localhost/34569] mob.MobFileCache(124): MobFileCache disabled 2023-07-23 23:05:58,872 INFO [Listener at localhost/34569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 23:05:58,873 INFO [Listener at localhost/34569] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 23:05:58,875 INFO [Listener at localhost/34569] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34863 connecting to ZooKeeper ensemble=127.0.0.1:58893 2023-07-23 23:05:58,881 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:348630x0, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-23 23:05:58,882 DEBUG [Listener at localhost/34569] zookeeper.ZKUtil(164): regionserver:348630x0, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 23:05:58,883 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34863-0x101946f1b500003 connected 2023-07-23 23:05:58,883 DEBUG [Listener at localhost/34569] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 23:05:58,884 DEBUG [Listener at localhost/34569] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-23 23:05:58,887 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34863 2023-07-23 23:05:58,887 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34863 2023-07-23 23:05:58,888 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34863 2023-07-23 23:05:58,891 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34863 2023-07-23 23:05:58,892 DEBUG [Listener at localhost/34569] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34863 2023-07-23 23:05:58,894 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,43049,1690153556996 2023-07-23 23:05:58,914 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-23 23:05:58,917 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,43049,1690153556996 2023-07-23 23:05:58,940 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 23:05:58,941 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 23:05:58,942 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 23:05:58,942 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 23:05:58,942 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-23 23:05:58,946 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-23 23:05:58,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,43049,1690153556996 from backup master directory 2023-07-23 23:05:58,948 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-23 23:05:58,953 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 23:05:58,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,43049,1690153556996 2023-07-23 23:05:58,956 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,43049,1690153556996 2023-07-23 23:05:58,956 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-23 23:05:58,956 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-23 23:05:58,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-23 23:05:59,074 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/hbase.id with ID: ce937395-a10d-4262-bc8b-f79ee636ffd4 2023-07-23 23:05:59,127 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-23 23:05:59,144 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 23:05:59,215 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5d8e9868 to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:05:59,255 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f39be6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:05:59,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 23:05:59,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-23 23:05:59,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-23 23:05:59,309 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-23 23:05:59,311 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-23 23:05:59,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-23 23:05:59,317 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 23:05:59,361 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/MasterData/data/master/store-tmp 2023-07-23 23:05:59,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:05:59,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-23 23:05:59,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 23:05:59,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 23:05:59,407 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-23 23:05:59,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 23:05:59,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 23:05:59,408 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-23 23:05:59,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/MasterData/WALs/jenkins-hbase4.apache.org,43049,1690153556996 2023-07-23 23:05:59,444 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43049%2C1690153556996, suffix=, logDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/MasterData/WALs/jenkins-hbase4.apache.org,43049,1690153556996, archiveDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/MasterData/oldWALs, maxLogs=10 2023-07-23 23:05:59,523 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41499,DS-cae23318-a657-4c1d-ac16-e239e44863df,DISK] 2023-07-23 23:05:59,523 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37469,DS-33db6f42-c4ec-465a-83a8-8f56cb0fbb0b,DISK] 2023-07-23 23:05:59,524 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35261,DS-502d90a2-5cdf-44e2-a171-489de05f99b6,DISK] 2023-07-23 23:05:59,535 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-23 23:05:59,669 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/MasterData/WALs/jenkins-hbase4.apache.org,43049,1690153556996/jenkins-hbase4.apache.org%2C43049%2C1690153556996.1690153559458 2023-07-23 23:05:59,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41499,DS-cae23318-a657-4c1d-ac16-e239e44863df,DISK], DatanodeInfoWithStorage[127.0.0.1:37469,DS-33db6f42-c4ec-465a-83a8-8f56cb0fbb0b,DISK], DatanodeInfoWithStorage[127.0.0.1:35261,DS-502d90a2-5cdf-44e2-a171-489de05f99b6,DISK]] 2023-07-23 23:05:59,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-23 23:05:59,672 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:05:59,676 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-23 23:05:59,678 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-23 23:05:59,770 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-23 23:05:59,781 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-23 23:05:59,818 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-23 23:05:59,832 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 23:05:59,838 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-23 23:05:59,840 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-23 23:05:59,856 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-23 23:05:59,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 23:05:59,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67657548, jitterRate=0.008176028728485107}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 23:05:59,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-23 23:05:59,863 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-23 23:05:59,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-23 23:05:59,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-23 23:05:59,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-23 23:05:59,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-23 23:05:59,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 43 msec 2023-07-23 23:05:59,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-23 23:05:59,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-23 23:05:59,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-23 23:06:00,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-23 23:06:00,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-23 23:06:00,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-23 23:06:00,039 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-23 23:06:00,045 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-23 23:06:00,049 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 23:06:00,051 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-23 23:06:00,052 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-23 23:06:00,068 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-23 23:06:00,073 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 23:06:00,073 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 23:06:00,073 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 23:06:00,073 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-23 23:06:00,073 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 23:06:00,075 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,43049,1690153556996, sessionid=0x101946f1b500000, setting cluster-up flag (Was=false) 2023-07-23 23:06:00,094 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 23:06:00,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-23 23:06:00,103 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43049,1690153556996 2023-07-23 23:06:00,109 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 23:06:00,118 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-23 23:06:00,120 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43049,1690153556996 2023-07-23 23:06:00,125 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp 2023-07-23 23:06:00,199 INFO [RS:0;jenkins-hbase4:39259] regionserver.HRegionServer(951): ClusterId : ce937395-a10d-4262-bc8b-f79ee636ffd4 2023-07-23 23:06:00,205 INFO [RS:1;jenkins-hbase4:38881] regionserver.HRegionServer(951): ClusterId : ce937395-a10d-4262-bc8b-f79ee636ffd4 2023-07-23 23:06:00,206 INFO [RS:2;jenkins-hbase4:34863] regionserver.HRegionServer(951): ClusterId : ce937395-a10d-4262-bc8b-f79ee636ffd4 2023-07-23 23:06:00,209 DEBUG [RS:2;jenkins-hbase4:34863] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-23 23:06:00,209 DEBUG [RS:1;jenkins-hbase4:38881] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-23 23:06:00,209 DEBUG [RS:0;jenkins-hbase4:39259] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-23 23:06:00,216 DEBUG [RS:1;jenkins-hbase4:38881] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-23 23:06:00,216 DEBUG [RS:2;jenkins-hbase4:34863] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-23 23:06:00,216 DEBUG [RS:0;jenkins-hbase4:39259] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-23 23:06:00,217 DEBUG [RS:2;jenkins-hbase4:34863] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-23 23:06:00,216 DEBUG [RS:1;jenkins-hbase4:38881] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-23 23:06:00,217 DEBUG [RS:0;jenkins-hbase4:39259] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-23 23:06:00,222 DEBUG [RS:2;jenkins-hbase4:34863] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-23 23:06:00,228 DEBUG [RS:1;jenkins-hbase4:38881] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-23 23:06:00,228 DEBUG [RS:0;jenkins-hbase4:39259] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-23 23:06:00,230 DEBUG [RS:2;jenkins-hbase4:34863] zookeeper.ReadOnlyZKClient(139): Connect 0x217a9942 to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:06:00,229 DEBUG [RS:1;jenkins-hbase4:38881] zookeeper.ReadOnlyZKClient(139): Connect 0x3860d335 to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:06:00,254 DEBUG [RS:0;jenkins-hbase4:39259] zookeeper.ReadOnlyZKClient(139): Connect 0x5fd93a1f to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:06:00,279 DEBUG [RS:2;jenkins-hbase4:34863] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fbd731d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:06:00,280 DEBUG [RS:1;jenkins-hbase4:38881] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36a73a49, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:06:00,281 DEBUG [RS:2;jenkins-hbase4:34863] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b82f232, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 23:06:00,281 DEBUG [RS:1;jenkins-hbase4:38881] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3298b845, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 23:06:00,282 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-23 23:06:00,288 DEBUG [RS:0;jenkins-hbase4:39259] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@511edf94, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:06:00,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 23:06:00,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-23 23:06:00,288 DEBUG [RS:0;jenkins-hbase4:39259] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1023d5af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 23:06:00,319 DEBUG [RS:1;jenkins-hbase4:38881] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38881 2023-07-23 23:06:00,319 DEBUG [RS:2;jenkins-hbase4:34863] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:34863 2023-07-23 23:06:00,320 DEBUG [RS:0;jenkins-hbase4:39259] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39259 2023-07-23 23:06:00,326 INFO [RS:1;jenkins-hbase4:38881] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-23 23:06:00,327 INFO [RS:1;jenkins-hbase4:38881] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-23 23:06:00,327 DEBUG [RS:1;jenkins-hbase4:38881] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-23 23:06:00,326 INFO [RS:0;jenkins-hbase4:39259] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-23 23:06:00,328 INFO [RS:0;jenkins-hbase4:39259] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-23 23:06:00,329 DEBUG [RS:0;jenkins-hbase4:39259] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-23 23:06:00,329 INFO [RS:0;jenkins-hbase4:39259] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 23:06:00,328 INFO [RS:1;jenkins-hbase4:38881] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 23:06:00,329 DEBUG [RS:0;jenkins-hbase4:39259] regionserver.HRegionServer(1022): About to register with Master. 2023-07-23 23:06:00,329 DEBUG [RS:1;jenkins-hbase4:38881] regionserver.HRegionServer(1022): About to register with Master. 2023-07-23 23:06:00,331 INFO [RS:2;jenkins-hbase4:34863] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-23 23:06:00,331 INFO [RS:2;jenkins-hbase4:34863] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-23 23:06:00,332 DEBUG [RS:2;jenkins-hbase4:34863] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-23 23:06:00,332 INFO [RS:2;jenkins-hbase4:34863] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 23:06:00,332 DEBUG [RS:2;jenkins-hbase4:34863] regionserver.HRegionServer(1022): About to register with Master. 2023-07-23 23:06:00,333 INFO [RS:0;jenkins-hbase4:39259] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43049,1690153556996 with isa=jenkins-hbase4.apache.org/172.31.14.131:39259, startcode=1690153558742 2023-07-23 23:06:00,334 INFO [RS:1;jenkins-hbase4:38881] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43049,1690153556996 with isa=jenkins-hbase4.apache.org/172.31.14.131:38881, startcode=1690153558819 2023-07-23 23:06:00,335 INFO [RS:2;jenkins-hbase4:34863] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43049,1690153556996 with isa=jenkins-hbase4.apache.org/172.31.14.131:34863, startcode=1690153558866 2023-07-23 23:06:00,358 DEBUG [RS:2;jenkins-hbase4:34863] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-23 23:06:00,358 DEBUG [RS:1;jenkins-hbase4:38881] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-23 23:06:00,358 DEBUG [RS:0;jenkins-hbase4:39259] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-23 23:06:00,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-23 23:06:00,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 23:06:00,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 23:06:00,454 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 23:06:00,454 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-23 23:06:00,454 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-23 23:06:00,454 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,455 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 23:06:00,455 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,464 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34323, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-23 23:06:00,464 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34581, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-23 23:06:00,479 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47545, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-23 23:06:00,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690153590482 2023-07-23 23:06:00,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-23 23:06:00,489 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43049] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-23 23:06:00,492 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-23 23:06:00,492 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-23 23:06:00,498 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-23 23:06:00,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-23 23:06:00,502 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43049] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-23 23:06:00,506 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43049] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-23 23:06:00,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-23 23:06:00,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-23 23:06:00,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-23 23:06:00,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-23 23:06:00,524 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:00,527 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-23 23:06:00,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-23 23:06:00,530 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-23 23:06:00,538 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-23 23:06:00,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-23 23:06:00,546 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690153560546,5,FailOnTimeoutGroup] 2023-07-23 23:06:00,547 DEBUG [RS:2;jenkins-hbase4:34863] regionserver.HRegionServer(2830): Master is not running yet 2023-07-23 23:06:00,547 DEBUG [RS:1;jenkins-hbase4:38881] regionserver.HRegionServer(2830): Master is not running yet 2023-07-23 23:06:00,547 WARN [RS:2;jenkins-hbase4:34863] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-23 23:06:00,547 WARN [RS:1;jenkins-hbase4:38881] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-23 23:06:00,549 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690153560546,5,FailOnTimeoutGroup] 2023-07-23 23:06:00,549 DEBUG [RS:0;jenkins-hbase4:39259] regionserver.HRegionServer(2830): Master is not running yet 2023-07-23 23:06:00,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:00,549 WARN [RS:0;jenkins-hbase4:39259] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-23 23:06:00,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-23 23:06:00,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:00,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:00,582 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-23 23:06:00,584 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-23 23:06:00,584 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f 2023-07-23 23:06:00,646 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:06:00,648 INFO [RS:2;jenkins-hbase4:34863] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43049,1690153556996 with isa=jenkins-hbase4.apache.org/172.31.14.131:34863, startcode=1690153558866 2023-07-23 23:06:00,648 INFO [RS:1;jenkins-hbase4:38881] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43049,1690153556996 with isa=jenkins-hbase4.apache.org/172.31.14.131:38881, startcode=1690153558819 2023-07-23 23:06:00,656 INFO [RS:0;jenkins-hbase4:39259] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43049,1690153556996 with isa=jenkins-hbase4.apache.org/172.31.14.131:39259, startcode=1690153558742 2023-07-23 23:06:00,660 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-23 23:06:00,667 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43049] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:00,674 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43049] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:00,675 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43049] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:00,679 DEBUG [RS:0;jenkins-hbase4:39259] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f 2023-07-23 23:06:00,679 DEBUG [RS:2;jenkins-hbase4:34863] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f 2023-07-23 23:06:00,679 DEBUG [RS:1;jenkins-hbase4:38881] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f 2023-07-23 23:06:00,679 DEBUG [RS:1;jenkins-hbase4:38881] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40459 2023-07-23 23:06:00,679 DEBUG [RS:1;jenkins-hbase4:38881] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-23 23:06:00,679 DEBUG [RS:0;jenkins-hbase4:39259] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40459 2023-07-23 23:06:00,680 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740/info 2023-07-23 23:06:00,683 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-23 23:06:00,679 DEBUG [RS:2;jenkins-hbase4:34863] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:40459 2023-07-23 23:06:00,682 DEBUG [RS:0;jenkins-hbase4:39259] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-23 23:06:00,685 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 23:06:00,685 DEBUG [RS:2;jenkins-hbase4:34863] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-23 23:06:00,686 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-23 23:06:00,688 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 23:06:00,691 DEBUG [RS:1;jenkins-hbase4:38881] zookeeper.ZKUtil(162): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:00,691 WARN [RS:1;jenkins-hbase4:38881] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 23:06:00,691 DEBUG [RS:2;jenkins-hbase4:34863] zookeeper.ZKUtil(162): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:00,692 DEBUG [RS:0;jenkins-hbase4:39259] zookeeper.ZKUtil(162): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:00,692 INFO [RS:1;jenkins-hbase4:38881] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 23:06:00,692 DEBUG [RS:1;jenkins-hbase4:38881] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/WALs/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:00,692 WARN [RS:2;jenkins-hbase4:34863] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 23:06:00,692 WARN [RS:0;jenkins-hbase4:39259] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-23 23:06:00,694 INFO [RS:2;jenkins-hbase4:34863] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 23:06:00,694 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740/rep_barrier 2023-07-23 23:06:00,695 DEBUG [RS:2;jenkins-hbase4:34863] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/WALs/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:00,694 INFO [RS:0;jenkins-hbase4:39259] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 23:06:00,695 DEBUG [RS:0;jenkins-hbase4:39259] regionserver.HRegionServer(1948): logDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/WALs/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:00,696 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-23 23:06:00,697 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 23:06:00,697 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-23 23:06:00,705 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38881,1690153558819] 2023-07-23 23:06:00,707 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39259,1690153558742] 2023-07-23 23:06:00,705 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740/table 2023-07-23 23:06:00,708 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34863,1690153558866] 2023-07-23 23:06:00,715 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-23 23:06:00,717 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 23:06:00,721 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740 2023-07-23 23:06:00,723 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740 2023-07-23 23:06:00,730 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-23 23:06:00,731 DEBUG [RS:0;jenkins-hbase4:39259] zookeeper.ZKUtil(162): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:00,731 DEBUG [RS:2;jenkins-hbase4:34863] zookeeper.ZKUtil(162): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:00,731 DEBUG [RS:1;jenkins-hbase4:38881] zookeeper.ZKUtil(162): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:00,732 DEBUG [RS:0;jenkins-hbase4:39259] zookeeper.ZKUtil(162): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:00,732 DEBUG [RS:0;jenkins-hbase4:39259] zookeeper.ZKUtil(162): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:00,733 DEBUG [RS:2;jenkins-hbase4:34863] zookeeper.ZKUtil(162): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:00,733 DEBUG [RS:1;jenkins-hbase4:38881] zookeeper.ZKUtil(162): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:00,733 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-23 23:06:00,734 DEBUG [RS:2;jenkins-hbase4:34863] zookeeper.ZKUtil(162): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:00,734 DEBUG [RS:1;jenkins-hbase4:38881] zookeeper.ZKUtil(162): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:00,745 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 23:06:00,747 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74600340, jitterRate=0.11163169145584106}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-23 23:06:00,747 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-23 23:06:00,747 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-23 23:06:00,747 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-23 23:06:00,747 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-23 23:06:00,747 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-23 23:06:00,747 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-23 23:06:00,749 DEBUG [RS:2;jenkins-hbase4:34863] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-23 23:06:00,749 DEBUG [RS:1;jenkins-hbase4:38881] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-23 23:06:00,755 DEBUG [RS:0;jenkins-hbase4:39259] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-23 23:06:00,756 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-23 23:06:00,763 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-23 23:06:00,771 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-23 23:06:00,772 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-23 23:06:00,777 INFO [RS:1;jenkins-hbase4:38881] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-23 23:06:00,777 INFO [RS:2;jenkins-hbase4:34863] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-23 23:06:00,777 INFO [RS:0;jenkins-hbase4:39259] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-23 23:06:00,784 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-23 23:06:00,809 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-23 23:06:00,826 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-23 23:06:00,829 INFO [RS:2;jenkins-hbase4:34863] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-23 23:06:00,835 INFO [RS:0;jenkins-hbase4:39259] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-23 23:06:00,850 INFO [RS:0;jenkins-hbase4:39259] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-23 23:06:00,850 INFO [RS:0;jenkins-hbase4:39259] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:00,857 INFO [RS:1;jenkins-hbase4:38881] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-23 23:06:00,859 INFO [RS:1;jenkins-hbase4:38881] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-23 23:06:00,865 INFO [RS:2;jenkins-hbase4:34863] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-23 23:06:00,865 INFO [RS:2;jenkins-hbase4:34863] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:00,867 INFO [RS:0;jenkins-hbase4:39259] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-23 23:06:00,870 INFO [RS:1;jenkins-hbase4:38881] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:00,873 INFO [RS:2;jenkins-hbase4:34863] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-23 23:06:00,878 INFO [RS:1;jenkins-hbase4:38881] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-23 23:06:00,881 INFO [RS:0;jenkins-hbase4:39259] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:00,881 DEBUG [RS:0;jenkins-hbase4:39259] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,881 INFO [RS:2;jenkins-hbase4:34863] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:00,881 DEBUG [RS:0;jenkins-hbase4:39259] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,882 DEBUG [RS:0;jenkins-hbase4:39259] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,882 DEBUG [RS:0;jenkins-hbase4:39259] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,882 DEBUG [RS:0;jenkins-hbase4:39259] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,881 DEBUG [RS:2;jenkins-hbase4:34863] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,882 DEBUG [RS:0;jenkins-hbase4:39259] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 23:06:00,883 DEBUG [RS:0;jenkins-hbase4:39259] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,883 INFO [RS:1;jenkins-hbase4:38881] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:00,883 DEBUG [RS:0;jenkins-hbase4:39259] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,883 DEBUG [RS:1;jenkins-hbase4:38881] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,883 DEBUG [RS:0;jenkins-hbase4:39259] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,883 DEBUG [RS:1;jenkins-hbase4:38881] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,883 DEBUG [RS:0;jenkins-hbase4:39259] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,883 DEBUG [RS:1;jenkins-hbase4:38881] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,884 DEBUG [RS:1;jenkins-hbase4:38881] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,884 DEBUG [RS:1;jenkins-hbase4:38881] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,884 DEBUG [RS:2;jenkins-hbase4:34863] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,884 DEBUG [RS:1;jenkins-hbase4:38881] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 23:06:00,884 DEBUG [RS:2;jenkins-hbase4:34863] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,884 DEBUG [RS:1;jenkins-hbase4:38881] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,884 DEBUG [RS:2;jenkins-hbase4:34863] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,884 DEBUG [RS:1;jenkins-hbase4:38881] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,885 DEBUG [RS:1;jenkins-hbase4:38881] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,884 DEBUG [RS:2;jenkins-hbase4:34863] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,885 DEBUG [RS:1;jenkins-hbase4:38881] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,886 DEBUG [RS:2;jenkins-hbase4:34863] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-23 23:06:00,886 DEBUG [RS:2;jenkins-hbase4:34863] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,886 DEBUG [RS:2;jenkins-hbase4:34863] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,886 DEBUG [RS:2;jenkins-hbase4:34863] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,886 DEBUG [RS:2;jenkins-hbase4:34863] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-23 23:06:00,899 INFO [RS:0;jenkins-hbase4:39259] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:00,899 INFO [RS:0;jenkins-hbase4:39259] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:00,899 INFO [RS:0;jenkins-hbase4:39259] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:00,904 INFO [RS:1;jenkins-hbase4:38881] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:00,909 INFO [RS:2;jenkins-hbase4:34863] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:00,909 INFO [RS:1;jenkins-hbase4:38881] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:00,909 INFO [RS:2;jenkins-hbase4:34863] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:00,909 INFO [RS:1;jenkins-hbase4:38881] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:00,909 INFO [RS:2;jenkins-hbase4:34863] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:00,928 INFO [RS:1;jenkins-hbase4:38881] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-23 23:06:00,928 INFO [RS:2;jenkins-hbase4:34863] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-23 23:06:00,931 INFO [RS:0;jenkins-hbase4:39259] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-23 23:06:00,932 INFO [RS:2;jenkins-hbase4:34863] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34863,1690153558866-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:00,932 INFO [RS:1;jenkins-hbase4:38881] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38881,1690153558819-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:00,932 INFO [RS:0;jenkins-hbase4:39259] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39259,1690153558742-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:00,965 INFO [RS:1;jenkins-hbase4:38881] regionserver.Replication(203): jenkins-hbase4.apache.org,38881,1690153558819 started 2023-07-23 23:06:00,966 INFO [RS:1;jenkins-hbase4:38881] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,38881,1690153558819, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38881, sessionid=0x101946f1b500002 2023-07-23 23:06:00,966 INFO [RS:0;jenkins-hbase4:39259] regionserver.Replication(203): jenkins-hbase4.apache.org,39259,1690153558742 started 2023-07-23 23:06:00,966 INFO [RS:0;jenkins-hbase4:39259] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39259,1690153558742, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39259, sessionid=0x101946f1b500001 2023-07-23 23:06:00,966 INFO [RS:2;jenkins-hbase4:34863] regionserver.Replication(203): jenkins-hbase4.apache.org,34863,1690153558866 started 2023-07-23 23:06:00,967 INFO [RS:2;jenkins-hbase4:34863] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34863,1690153558866, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34863, sessionid=0x101946f1b500003 2023-07-23 23:06:00,967 DEBUG [RS:2;jenkins-hbase4:34863] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-23 23:06:00,967 DEBUG [RS:0;jenkins-hbase4:39259] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-23 23:06:00,967 DEBUG [RS:2;jenkins-hbase4:34863] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:00,968 DEBUG [RS:1;jenkins-hbase4:38881] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-23 23:06:00,969 DEBUG [RS:1;jenkins-hbase4:38881] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:00,969 DEBUG [RS:2;jenkins-hbase4:34863] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34863,1690153558866' 2023-07-23 23:06:00,969 DEBUG [RS:2;jenkins-hbase4:34863] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-23 23:06:00,967 DEBUG [RS:0;jenkins-hbase4:39259] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:00,970 DEBUG [RS:0;jenkins-hbase4:39259] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39259,1690153558742' 2023-07-23 23:06:00,970 DEBUG [RS:0;jenkins-hbase4:39259] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-23 23:06:00,969 DEBUG [RS:1;jenkins-hbase4:38881] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38881,1690153558819' 2023-07-23 23:06:00,971 DEBUG [RS:1;jenkins-hbase4:38881] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-23 23:06:00,972 DEBUG [RS:1;jenkins-hbase4:38881] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-23 23:06:00,973 DEBUG [RS:1;jenkins-hbase4:38881] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-23 23:06:00,973 DEBUG [RS:1;jenkins-hbase4:38881] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-23 23:06:00,973 DEBUG [RS:1;jenkins-hbase4:38881] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:00,973 DEBUG [RS:1;jenkins-hbase4:38881] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38881,1690153558819' 2023-07-23 23:06:00,973 DEBUG [RS:1;jenkins-hbase4:38881] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:00,973 DEBUG [RS:0;jenkins-hbase4:39259] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-23 23:06:00,973 DEBUG [RS:2;jenkins-hbase4:34863] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-23 23:06:00,975 DEBUG [RS:0;jenkins-hbase4:39259] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-23 23:06:00,975 DEBUG [RS:0;jenkins-hbase4:39259] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-23 23:06:00,976 DEBUG [RS:1;jenkins-hbase4:38881] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:00,976 DEBUG [RS:2;jenkins-hbase4:34863] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-23 23:06:00,976 DEBUG [RS:2;jenkins-hbase4:34863] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-23 23:06:00,977 DEBUG [RS:2;jenkins-hbase4:34863] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:00,975 DEBUG [RS:0;jenkins-hbase4:39259] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:00,977 DEBUG [RS:0;jenkins-hbase4:39259] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39259,1690153558742' 2023-07-23 23:06:00,977 DEBUG [RS:0;jenkins-hbase4:39259] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:00,977 DEBUG [RS:2;jenkins-hbase4:34863] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34863,1690153558866' 2023-07-23 23:06:00,977 DEBUG [RS:2;jenkins-hbase4:34863] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:00,977 DEBUG [RS:1;jenkins-hbase4:38881] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-23 23:06:00,977 INFO [RS:1;jenkins-hbase4:38881] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-23 23:06:00,977 INFO [RS:1;jenkins-hbase4:38881] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-23 23:06:00,978 DEBUG [RS:0;jenkins-hbase4:39259] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:00,978 DEBUG [RS:2;jenkins-hbase4:34863] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:00,978 DEBUG [RS:0;jenkins-hbase4:39259] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-23 23:06:00,978 INFO [RS:0;jenkins-hbase4:39259] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-23 23:06:00,979 INFO [RS:0;jenkins-hbase4:39259] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-23 23:06:00,980 DEBUG [RS:2;jenkins-hbase4:34863] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-23 23:06:00,980 INFO [RS:2;jenkins-hbase4:34863] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-23 23:06:00,980 INFO [RS:2;jenkins-hbase4:34863] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-23 23:06:00,999 DEBUG [jenkins-hbase4:43049] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-23 23:06:01,004 DEBUG [jenkins-hbase4:43049] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 23:06:01,012 DEBUG [jenkins-hbase4:43049] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 23:06:01,012 DEBUG [jenkins-hbase4:43049] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 23:06:01,012 DEBUG [jenkins-hbase4:43049] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 23:06:01,013 DEBUG [jenkins-hbase4:43049] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 23:06:01,016 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38881,1690153558819, state=OPENING 2023-07-23 23:06:01,031 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-23 23:06:01,033 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 23:06:01,034 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-23 23:06:01,040 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38881,1690153558819}] 2023-07-23 23:06:01,093 INFO [RS:1;jenkins-hbase4:38881] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38881%2C1690153558819, suffix=, logDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/WALs/jenkins-hbase4.apache.org,38881,1690153558819, archiveDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/oldWALs, maxLogs=32 2023-07-23 23:06:01,096 INFO [RS:0;jenkins-hbase4:39259] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39259%2C1690153558742, suffix=, logDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/WALs/jenkins-hbase4.apache.org,39259,1690153558742, archiveDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/oldWALs, maxLogs=32 2023-07-23 23:06:01,106 INFO [RS:2;jenkins-hbase4:34863] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34863%2C1690153558866, suffix=, logDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/WALs/jenkins-hbase4.apache.org,34863,1690153558866, archiveDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/oldWALs, maxLogs=32 2023-07-23 23:06:01,170 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37469,DS-33db6f42-c4ec-465a-83a8-8f56cb0fbb0b,DISK] 2023-07-23 23:06:01,170 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35261,DS-502d90a2-5cdf-44e2-a171-489de05f99b6,DISK] 2023-07-23 23:06:01,190 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35261,DS-502d90a2-5cdf-44e2-a171-489de05f99b6,DISK] 2023-07-23 23:06:01,190 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41499,DS-cae23318-a657-4c1d-ac16-e239e44863df,DISK] 2023-07-23 23:06:01,198 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41499,DS-cae23318-a657-4c1d-ac16-e239e44863df,DISK] 2023-07-23 23:06:01,199 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37469,DS-33db6f42-c4ec-465a-83a8-8f56cb0fbb0b,DISK] 2023-07-23 23:06:01,199 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37469,DS-33db6f42-c4ec-465a-83a8-8f56cb0fbb0b,DISK] 2023-07-23 23:06:01,199 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41499,DS-cae23318-a657-4c1d-ac16-e239e44863df,DISK] 2023-07-23 23:06:01,200 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35261,DS-502d90a2-5cdf-44e2-a171-489de05f99b6,DISK] 2023-07-23 23:06:01,226 INFO [RS:0;jenkins-hbase4:39259] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/WALs/jenkins-hbase4.apache.org,39259,1690153558742/jenkins-hbase4.apache.org%2C39259%2C1690153558742.1690153561104 2023-07-23 23:06:01,227 DEBUG [RS:0;jenkins-hbase4:39259] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37469,DS-33db6f42-c4ec-465a-83a8-8f56cb0fbb0b,DISK], DatanodeInfoWithStorage[127.0.0.1:41499,DS-cae23318-a657-4c1d-ac16-e239e44863df,DISK], DatanodeInfoWithStorage[127.0.0.1:35261,DS-502d90a2-5cdf-44e2-a171-489de05f99b6,DISK]] 2023-07-23 23:06:01,232 INFO [RS:2;jenkins-hbase4:34863] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/WALs/jenkins-hbase4.apache.org,34863,1690153558866/jenkins-hbase4.apache.org%2C34863%2C1690153558866.1690153561110 2023-07-23 23:06:01,234 DEBUG [RS:2;jenkins-hbase4:34863] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35261,DS-502d90a2-5cdf-44e2-a171-489de05f99b6,DISK], DatanodeInfoWithStorage[127.0.0.1:37469,DS-33db6f42-c4ec-465a-83a8-8f56cb0fbb0b,DISK], DatanodeInfoWithStorage[127.0.0.1:41499,DS-cae23318-a657-4c1d-ac16-e239e44863df,DISK]] 2023-07-23 23:06:01,240 INFO [RS:1;jenkins-hbase4:38881] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/WALs/jenkins-hbase4.apache.org,38881,1690153558819/jenkins-hbase4.apache.org%2C38881%2C1690153558819.1690153561103 2023-07-23 23:06:01,240 DEBUG [RS:1;jenkins-hbase4:38881] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37469,DS-33db6f42-c4ec-465a-83a8-8f56cb0fbb0b,DISK], DatanodeInfoWithStorage[127.0.0.1:41499,DS-cae23318-a657-4c1d-ac16-e239e44863df,DISK], DatanodeInfoWithStorage[127.0.0.1:35261,DS-502d90a2-5cdf-44e2-a171-489de05f99b6,DISK]] 2023-07-23 23:06:01,267 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:01,270 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 23:06:01,277 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45370, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 23:06:01,297 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-23 23:06:01,297 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-23 23:06:01,301 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38881%2C1690153558819.meta, suffix=.meta, logDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/WALs/jenkins-hbase4.apache.org,38881,1690153558819, archiveDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/oldWALs, maxLogs=32 2023-07-23 23:06:01,331 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37469,DS-33db6f42-c4ec-465a-83a8-8f56cb0fbb0b,DISK] 2023-07-23 23:06:01,336 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35261,DS-502d90a2-5cdf-44e2-a171-489de05f99b6,DISK] 2023-07-23 23:06:01,338 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41499,DS-cae23318-a657-4c1d-ac16-e239e44863df,DISK] 2023-07-23 23:06:01,354 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/WALs/jenkins-hbase4.apache.org,38881,1690153558819/jenkins-hbase4.apache.org%2C38881%2C1690153558819.meta.1690153561303.meta 2023-07-23 23:06:01,356 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37469,DS-33db6f42-c4ec-465a-83a8-8f56cb0fbb0b,DISK], DatanodeInfoWithStorage[127.0.0.1:35261,DS-502d90a2-5cdf-44e2-a171-489de05f99b6,DISK], DatanodeInfoWithStorage[127.0.0.1:41499,DS-cae23318-a657-4c1d-ac16-e239e44863df,DISK]] 2023-07-23 23:06:01,356 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-23 23:06:01,358 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-23 23:06:01,359 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 23:06:01,361 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-23 23:06:01,368 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-23 23:06:01,380 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-23 23:06:01,401 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-23 23:06:01,401 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:06:01,401 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-23 23:06:01,401 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-23 23:06:01,405 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-23 23:06:01,407 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740/info 2023-07-23 23:06:01,409 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740/info 2023-07-23 23:06:01,410 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-23 23:06:01,413 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 23:06:01,413 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-23 23:06:01,416 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740/rep_barrier 2023-07-23 23:06:01,416 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740/rep_barrier 2023-07-23 23:06:01,417 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-23 23:06:01,418 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 23:06:01,418 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-23 23:06:01,420 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740/table 2023-07-23 23:06:01,420 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740/table 2023-07-23 23:06:01,420 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-23 23:06:01,422 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 23:06:01,425 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740 2023-07-23 23:06:01,431 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740 2023-07-23 23:06:01,489 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-23 23:06:01,495 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-23 23:06:01,497 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65522000, jitterRate=-0.023646116256713867}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-23 23:06:01,502 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-23 23:06:01,523 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690153561252 2023-07-23 23:06:01,551 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-23 23:06:01,553 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-23 23:06:01,553 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38881,1690153558819, state=OPEN 2023-07-23 23:06:01,556 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-23 23:06:01,556 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-23 23:06:01,562 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-23 23:06:01,562 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38881,1690153558819 in 516 msec 2023-07-23 23:06:01,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-23 23:06:01,568 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 779 msec 2023-07-23 23:06:01,574 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.2660 sec 2023-07-23 23:06:01,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690153561574, completionTime=-1 2023-07-23 23:06:01,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-23 23:06:01,574 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-23 23:06:01,676 DEBUG [hconnection-0x5c344f42-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:06:01,680 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45384, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:06:01,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-23 23:06:01,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690153621710 2023-07-23 23:06:01,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690153681711 2023-07-23 23:06:01,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 136 msec 2023-07-23 23:06:01,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43049,1690153556996-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:01,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43049,1690153556996-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:01,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43049,1690153556996-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:01,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:43049, period=300000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:01,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-23 23:06:01,757 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-23 23:06:01,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-23 23:06:01,770 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-23 23:06:01,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-23 23:06:01,786 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 23:06:01,790 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 23:06:01,818 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/hbase/namespace/9badc324f1e32204a0086773ddf03343 2023-07-23 23:06:01,822 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/hbase/namespace/9badc324f1e32204a0086773ddf03343 empty. 2023-07-23 23:06:01,823 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/hbase/namespace/9badc324f1e32204a0086773ddf03343 2023-07-23 23:06:01,823 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-23 23:06:01,890 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-23 23:06:01,893 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9badc324f1e32204a0086773ddf03343, NAME => 'hbase:namespace,,1690153561769.9badc324f1e32204a0086773ddf03343.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp 2023-07-23 23:06:01,927 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690153561769.9badc324f1e32204a0086773ddf03343.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:06:01,927 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 9badc324f1e32204a0086773ddf03343, disabling compactions & flushes 2023-07-23 23:06:01,927 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690153561769.9badc324f1e32204a0086773ddf03343. 2023-07-23 23:06:01,927 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690153561769.9badc324f1e32204a0086773ddf03343. 2023-07-23 23:06:01,927 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690153561769.9badc324f1e32204a0086773ddf03343. after waiting 0 ms 2023-07-23 23:06:01,927 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690153561769.9badc324f1e32204a0086773ddf03343. 2023-07-23 23:06:01,928 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690153561769.9badc324f1e32204a0086773ddf03343. 2023-07-23 23:06:01,928 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 9badc324f1e32204a0086773ddf03343: 2023-07-23 23:06:01,934 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 23:06:01,951 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690153561769.9badc324f1e32204a0086773ddf03343.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690153561937"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153561937"}]},"ts":"1690153561937"} 2023-07-23 23:06:01,980 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-23 23:06:01,982 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 23:06:01,986 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153561982"}]},"ts":"1690153561982"} 2023-07-23 23:06:01,990 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-23 23:06:01,994 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 23:06:01,996 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 23:06:01,996 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 23:06:01,996 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 23:06:01,996 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 23:06:01,999 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=9badc324f1e32204a0086773ddf03343, ASSIGN}] 2023-07-23 23:06:02,004 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=9badc324f1e32204a0086773ddf03343, ASSIGN 2023-07-23 23:06:02,007 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=9badc324f1e32204a0086773ddf03343, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1690153558819; forceNewPlan=false, retain=false 2023-07-23 23:06:02,160 INFO [jenkins-hbase4:43049] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-23 23:06:02,161 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=9badc324f1e32204a0086773ddf03343, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:02,161 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690153561769.9badc324f1e32204a0086773ddf03343.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690153562161"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153562161"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153562161"}]},"ts":"1690153562161"} 2023-07-23 23:06:02,165 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 9badc324f1e32204a0086773ddf03343, server=jenkins-hbase4.apache.org,38881,1690153558819}] 2023-07-23 23:06:02,327 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690153561769.9badc324f1e32204a0086773ddf03343. 2023-07-23 23:06:02,327 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9badc324f1e32204a0086773ddf03343, NAME => 'hbase:namespace,,1690153561769.9badc324f1e32204a0086773ddf03343.', STARTKEY => '', ENDKEY => ''} 2023-07-23 23:06:02,328 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690153561769.9badc324f1e32204a0086773ddf03343. service=AccessControlService 2023-07-23 23:06:02,329 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 23:06:02,329 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 9badc324f1e32204a0086773ddf03343 2023-07-23 23:06:02,329 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690153561769.9badc324f1e32204a0086773ddf03343.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:06:02,329 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9badc324f1e32204a0086773ddf03343 2023-07-23 23:06:02,329 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9badc324f1e32204a0086773ddf03343 2023-07-23 23:06:02,332 INFO [StoreOpener-9badc324f1e32204a0086773ddf03343-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 9badc324f1e32204a0086773ddf03343 2023-07-23 23:06:02,335 DEBUG [StoreOpener-9badc324f1e32204a0086773ddf03343-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/namespace/9badc324f1e32204a0086773ddf03343/info 2023-07-23 23:06:02,335 DEBUG [StoreOpener-9badc324f1e32204a0086773ddf03343-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/namespace/9badc324f1e32204a0086773ddf03343/info 2023-07-23 23:06:02,336 INFO [StoreOpener-9badc324f1e32204a0086773ddf03343-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9badc324f1e32204a0086773ddf03343 columnFamilyName info 2023-07-23 23:06:02,337 INFO [StoreOpener-9badc324f1e32204a0086773ddf03343-1] regionserver.HStore(310): Store=9badc324f1e32204a0086773ddf03343/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 23:06:02,340 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/namespace/9badc324f1e32204a0086773ddf03343 2023-07-23 23:06:02,346 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/namespace/9badc324f1e32204a0086773ddf03343 2023-07-23 23:06:02,352 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9badc324f1e32204a0086773ddf03343 2023-07-23 23:06:02,357 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/namespace/9badc324f1e32204a0086773ddf03343/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 23:06:02,358 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9badc324f1e32204a0086773ddf03343; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70990495, jitterRate=0.05784080922603607}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 23:06:02,358 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9badc324f1e32204a0086773ddf03343: 2023-07-23 23:06:02,360 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690153561769.9badc324f1e32204a0086773ddf03343., pid=6, masterSystemTime=1690153562319 2023-07-23 23:06:02,366 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690153561769.9badc324f1e32204a0086773ddf03343. 2023-07-23 23:06:02,366 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690153561769.9badc324f1e32204a0086773ddf03343. 2023-07-23 23:06:02,370 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=9badc324f1e32204a0086773ddf03343, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:02,370 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690153561769.9badc324f1e32204a0086773ddf03343.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690153562369"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690153562369"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690153562369"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690153562369"}]},"ts":"1690153562369"} 2023-07-23 23:06:02,379 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-23 23:06:02,380 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 9badc324f1e32204a0086773ddf03343, server=jenkins-hbase4.apache.org,38881,1690153558819 in 210 msec 2023-07-23 23:06:02,383 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-23 23:06:02,384 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=9badc324f1e32204a0086773ddf03343, ASSIGN in 381 msec 2023-07-23 23:06:02,385 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 23:06:02,386 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153562385"}]},"ts":"1690153562385"} 2023-07-23 23:06:02,388 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-23 23:06:02,392 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 23:06:02,396 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 621 msec 2023-07-23 23:06:02,486 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-23 23:06:02,491 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-23 23:06:02,491 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 23:06:02,538 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-23 23:06:02,558 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-23 23:06:02,565 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 36 msec 2023-07-23 23:06:02,572 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-23 23:06:02,585 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-23 23:06:02,594 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 20 msec 2023-07-23 23:06:02,612 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-23 23:06:02,616 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-23 23:06:02,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.663sec 2023-07-23 23:06:02,620 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-23 23:06:02,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-23 23:06:02,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-23 23:06:02,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43049,1690153556996-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-23 23:06:02,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43049,1690153556996-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-23 23:06:02,629 DEBUG [Listener at localhost/34569] zookeeper.ReadOnlyZKClient(139): Connect 0x092a69b5 to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:06:02,639 DEBUG [Listener at localhost/34569] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@203508e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:06:02,655 DEBUG [hconnection-0x41a54ec6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:06:02,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-23 23:06:02,661 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-23 23:06:02,663 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 23:06:02,666 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 23:06:02,668 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45398, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:06:02,668 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/hbase/acl/5f64a7f0784611af52afe26606ce595c 2023-07-23 23:06:02,669 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-23 23:06:02,669 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/hbase/acl/5f64a7f0784611af52afe26606ce595c empty. 2023-07-23 23:06:02,671 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/hbase/acl/5f64a7f0784611af52afe26606ce595c 2023-07-23 23:06:02,671 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-23 23:06:02,674 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,43049,1690153556996 2023-07-23 23:06:02,675 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-23 23:06:02,675 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/test.cache.data in system properties and HBase conf 2023-07-23 23:06:02,675 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/hadoop.tmp.dir in system properties and HBase conf 2023-07-23 23:06:02,675 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/hadoop.log.dir in system properties and HBase conf 2023-07-23 23:06:02,675 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-23 23:06:02,675 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-23 23:06:02,675 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-23 23:06:02,675 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-23 23:06:02,675 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-23 23:06:02,676 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-23 23:06:02,676 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 23:06:02,676 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-23 23:06:02,676 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-23 23:06:02,676 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-23 23:06:02,676 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 23:06:02,676 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-23 23:06:02,676 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/nfs.dump.dir in system properties and HBase conf 2023-07-23 23:06:02,676 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/java.io.tmpdir in system properties and HBase conf 2023-07-23 23:06:02,676 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-23 23:06:02,676 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-23 23:06:02,677 INFO [Listener at localhost/34569] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-23 23:06:02,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 23:06:02,704 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-23 23:06:02,705 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5f64a7f0784611af52afe26606ce595c, NAME => 'hbase:acl,,1690153562651.5f64a7f0784611af52afe26606ce595c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp 2023-07-23 23:06:02,770 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690153562651.5f64a7f0784611af52afe26606ce595c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:06:02,770 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 5f64a7f0784611af52afe26606ce595c, disabling compactions & flushes 2023-07-23 23:06:02,770 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690153562651.5f64a7f0784611af52afe26606ce595c. 2023-07-23 23:06:02,771 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690153562651.5f64a7f0784611af52afe26606ce595c. 2023-07-23 23:06:02,771 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690153562651.5f64a7f0784611af52afe26606ce595c. after waiting 0 ms 2023-07-23 23:06:02,771 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690153562651.5f64a7f0784611af52afe26606ce595c. 2023-07-23 23:06:02,771 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1690153562651.5f64a7f0784611af52afe26606ce595c. 2023-07-23 23:06:02,771 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 5f64a7f0784611af52afe26606ce595c: 2023-07-23 23:06:02,778 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 23:06:02,782 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1690153562651.5f64a7f0784611af52afe26606ce595c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690153562781"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153562781"}]},"ts":"1690153562781"} 2023-07-23 23:06:02,784 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 23:06:02,785 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-23 23:06:02,787 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 23:06:02,787 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153562787"}]},"ts":"1690153562787"} 2023-07-23 23:06:02,790 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-23 23:06:02,800 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 23:06:02,802 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 23:06:02,802 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 23:06:02,802 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 23:06:02,802 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 23:06:02,802 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=5f64a7f0784611af52afe26606ce595c, ASSIGN}] 2023-07-23 23:06:02,807 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=5f64a7f0784611af52afe26606ce595c, ASSIGN 2023-07-23 23:06:02,808 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=5f64a7f0784611af52afe26606ce595c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34863,1690153558866; forceNewPlan=false, retain=false 2023-07-23 23:06:02,959 INFO [jenkins-hbase4:43049] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-23 23:06:02,960 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=5f64a7f0784611af52afe26606ce595c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:02,960 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1690153562651.5f64a7f0784611af52afe26606ce595c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690153562960"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153562960"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153562960"}]},"ts":"1690153562960"} 2023-07-23 23:06:02,964 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 5f64a7f0784611af52afe26606ce595c, server=jenkins-hbase4.apache.org,34863,1690153558866}] 2023-07-23 23:06:02,984 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 23:06:03,119 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:03,119 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 23:06:03,124 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35770, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 23:06:03,139 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1690153562651.5f64a7f0784611af52afe26606ce595c. 2023-07-23 23:06:03,139 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5f64a7f0784611af52afe26606ce595c, NAME => 'hbase:acl,,1690153562651.5f64a7f0784611af52afe26606ce595c.', STARTKEY => '', ENDKEY => ''} 2023-07-23 23:06:03,140 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690153562651.5f64a7f0784611af52afe26606ce595c. service=AccessControlService 2023-07-23 23:06:03,140 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 23:06:03,140 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 5f64a7f0784611af52afe26606ce595c 2023-07-23 23:06:03,140 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690153562651.5f64a7f0784611af52afe26606ce595c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:06:03,141 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5f64a7f0784611af52afe26606ce595c 2023-07-23 23:06:03,141 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5f64a7f0784611af52afe26606ce595c 2023-07-23 23:06:03,143 INFO [StoreOpener-5f64a7f0784611af52afe26606ce595c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 5f64a7f0784611af52afe26606ce595c 2023-07-23 23:06:03,147 DEBUG [StoreOpener-5f64a7f0784611af52afe26606ce595c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/acl/5f64a7f0784611af52afe26606ce595c/l 2023-07-23 23:06:03,148 DEBUG [StoreOpener-5f64a7f0784611af52afe26606ce595c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/acl/5f64a7f0784611af52afe26606ce595c/l 2023-07-23 23:06:03,148 INFO [StoreOpener-5f64a7f0784611af52afe26606ce595c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f64a7f0784611af52afe26606ce595c columnFamilyName l 2023-07-23 23:06:03,149 INFO [StoreOpener-5f64a7f0784611af52afe26606ce595c-1] regionserver.HStore(310): Store=5f64a7f0784611af52afe26606ce595c/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 23:06:03,152 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/acl/5f64a7f0784611af52afe26606ce595c 2023-07-23 23:06:03,153 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/acl/5f64a7f0784611af52afe26606ce595c 2023-07-23 23:06:03,159 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5f64a7f0784611af52afe26606ce595c 2023-07-23 23:06:03,165 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/acl/5f64a7f0784611af52afe26606ce595c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 23:06:03,167 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5f64a7f0784611af52afe26606ce595c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72134833, jitterRate=0.07489277422428131}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 23:06:03,168 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5f64a7f0784611af52afe26606ce595c: 2023-07-23 23:06:03,171 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1690153562651.5f64a7f0784611af52afe26606ce595c., pid=11, masterSystemTime=1690153563119 2023-07-23 23:06:03,184 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=5f64a7f0784611af52afe26606ce595c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:03,184 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1690153562651.5f64a7f0784611af52afe26606ce595c.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690153563184"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690153563184"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690153563184"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690153563184"}]},"ts":"1690153563184"} 2023-07-23 23:06:03,186 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1690153562651.5f64a7f0784611af52afe26606ce595c. 2023-07-23 23:06:03,187 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1690153562651.5f64a7f0784611af52afe26606ce595c. 2023-07-23 23:06:03,202 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-23 23:06:03,202 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 5f64a7f0784611af52afe26606ce595c, server=jenkins-hbase4.apache.org,34863,1690153558866 in 228 msec 2023-07-23 23:06:03,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-23 23:06:03,207 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=5f64a7f0784611af52afe26606ce595c, ASSIGN in 400 msec 2023-07-23 23:06:03,208 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 23:06:03,208 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153563208"}]},"ts":"1690153563208"} 2023-07-23 23:06:03,211 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-23 23:06:03,216 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 23:06:03,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 558 msec 2023-07-23 23:06:03,284 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-23 23:06:03,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-23 23:06:03,296 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-23 23:06:04,111 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 23:06:04,517 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 23:06:04,524 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_32881_jobhistory____srqal7/webapp 2023-07-23 23:06:04,717 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-23 23:06:04,718 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-23 23:06:04,718 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 23:06:04,721 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 23:06:04,817 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 23:06:05,227 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 23:06:05,703 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-23 23:06:05,767 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:32881 2023-07-23 23:06:06,961 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 23:06:07,296 WARN [Listener at jenkins-hbase4.apache.org/34483] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 23:06:07,296 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-23 23:06:07,298 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-23 23:06:07,299 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-23 23:06:07,300 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:06:07,300 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-23 23:06:07,301 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:06:07,301 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-23 23:06:07,301 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-23 23:06:07,301 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-23 23:06:07,301 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:06:07,301 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-23 23:06:07,301 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-23 23:06:07,301 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-23 23:06:07,397 WARN [Listener at jenkins-hbase4.apache.org/34483] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-23 23:06:07,398 INFO [Listener at jenkins-hbase4.apache.org/34483] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 23:06:07,405 INFO [Listener at jenkins-hbase4.apache.org/34483] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38909_cluster____.ncql15/webapp 2023-07-23 23:06:07,486 INFO [Listener at jenkins-hbase4.apache.org/34483] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-23 23:06:07,486 INFO [Listener at jenkins-hbase4.apache.org/34483] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-23 23:06:07,486 INFO [Listener at jenkins-hbase4.apache.org/34483] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 23:06:07,487 INFO [Listener at jenkins-hbase4.apache.org/34483] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 23:06:07,499 INFO [Listener at jenkins-hbase4.apache.org/34483] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 23:06:07,759 INFO [Listener at jenkins-hbase4.apache.org/34483] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 23:06:07,879 INFO [Listener at jenkins-hbase4.apache.org/34483] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 23:06:07,894 INFO [Listener at jenkins-hbase4.apache.org/34483] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38909 2023-07-23 23:06:08,406 WARN [Listener at jenkins-hbase4.apache.org/33137] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 23:06:08,433 WARN [Listener at jenkins-hbase4.apache.org/33137] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-23 23:06:08,434 INFO [Listener at jenkins-hbase4.apache.org/33137] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 23:06:08,444 INFO [Listener at jenkins-hbase4.apache.org/33137] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34621_node____.cegtla/webapp 2023-07-23 23:06:08,520 INFO [Listener at jenkins-hbase4.apache.org/33137] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-23 23:06:08,521 INFO [Listener at jenkins-hbase4.apache.org/33137] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 23:06:08,521 INFO [Listener at jenkins-hbase4.apache.org/33137] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-23 23:06:08,521 INFO [Listener at jenkins-hbase4.apache.org/33137] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 23:06:08,535 INFO [Listener at jenkins-hbase4.apache.org/33137] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 23:06:08,566 INFO [Listener at jenkins-hbase4.apache.org/33137] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 23:06:08,667 INFO [Listener at jenkins-hbase4.apache.org/33137] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 23:06:08,682 INFO [Listener at jenkins-hbase4.apache.org/33137] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34621 2023-07-23 23:06:08,901 WARN [Listener at jenkins-hbase4.apache.org/42491] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-23 23:06:08,909 WARN [Listener at jenkins-hbase4.apache.org/42491] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-23 23:06:08,910 INFO [Listener at jenkins-hbase4.apache.org/42491] log.Slf4jLog(67): jetty-6.1.26 2023-07-23 23:06:08,918 INFO [Listener at jenkins-hbase4.apache.org/42491] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38453_node____.dyk705/webapp 2023-07-23 23:06:08,982 INFO [Listener at jenkins-hbase4.apache.org/42491] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-23 23:06:08,982 INFO [Listener at jenkins-hbase4.apache.org/42491] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-23 23:06:08,982 INFO [Listener at jenkins-hbase4.apache.org/42491] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-23 23:06:08,983 INFO [Listener at jenkins-hbase4.apache.org/42491] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-23 23:06:08,995 INFO [Listener at jenkins-hbase4.apache.org/42491] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 23:06:09,018 INFO [Listener at jenkins-hbase4.apache.org/42491] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 23:06:09,108 INFO [Listener at jenkins-hbase4.apache.org/42491] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-23 23:06:09,115 INFO [Listener at jenkins-hbase4.apache.org/42491] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38453 2023-07-23 23:06:09,154 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-23 23:06:09,156 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 23:06:09,237 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=135, ProcessCount=172, AvailableMemoryMB=7816 2023-07-23 23:06:09,238 WARN [Listener at jenkins-hbase4.apache.org/42491] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-07-23 23:06:09,256 DEBUG [Listener at jenkins-hbase4.apache.org/42491] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-23 23:06:09,263 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58292, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-23 23:06:09,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-23 23:06:09,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-23 23:06:09,278 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 23:06:09,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-23 23:06:09,281 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 23:06:09,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 23:06:09,286 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportWithTargetName/4f6a27ab2aae4be53ce220547c89f776 2023-07-23 23:06:09,286 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportWithTargetName/f1e3edc737813c75567863079b600774 2023-07-23 23:06:09,288 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportWithTargetName/4f6a27ab2aae4be53ce220547c89f776 empty. 2023-07-23 23:06:09,288 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportWithTargetName/f1e3edc737813c75567863079b600774 empty. 2023-07-23 23:06:09,289 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportWithTargetName/4f6a27ab2aae4be53ce220547c89f776 2023-07-23 23:06:09,290 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportWithTargetName/f1e3edc737813c75567863079b600774 2023-07-23 23:06:09,290 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-23 23:06:09,325 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-23 23:06:09,327 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => f1e3edc737813c75567863079b600774, NAME => 'testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp 2023-07-23 23:06:09,327 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4f6a27ab2aae4be53ce220547c89f776, NAME => 'testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp 2023-07-23 23:06:09,367 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:06:09,371 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing f1e3edc737813c75567863079b600774, disabling compactions & flushes 2023-07-23 23:06:09,372 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774. 2023-07-23 23:06:09,374 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774. 2023-07-23 23:06:09,374 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774. after waiting 0 ms 2023-07-23 23:06:09,374 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774. 2023-07-23 23:06:09,374 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774. 2023-07-23 23:06:09,374 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for f1e3edc737813c75567863079b600774: 2023-07-23 23:06:09,375 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:06:09,376 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 4f6a27ab2aae4be53ce220547c89f776, disabling compactions & flushes 2023-07-23 23:06:09,376 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776. 2023-07-23 23:06:09,376 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776. 2023-07-23 23:06:09,376 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776. after waiting 0 ms 2023-07-23 23:06:09,376 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776. 2023-07-23 23:06:09,376 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776. 2023-07-23 23:06:09,376 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 4f6a27ab2aae4be53ce220547c89f776: 2023-07-23 23:06:09,379 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 23:06:09,381 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690153569380"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153569380"}]},"ts":"1690153569380"} 2023-07-23 23:06:09,381 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690153569380"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153569380"}]},"ts":"1690153569380"} 2023-07-23 23:06:09,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 23:06:09,428 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 23:06:09,430 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 23:06:09,430 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153569430"}]},"ts":"1690153569430"} 2023-07-23 23:06:09,432 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-23 23:06:09,437 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 23:06:09,439 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 23:06:09,439 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 23:06:09,439 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 23:06:09,439 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 23:06:09,440 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4f6a27ab2aae4be53ce220547c89f776, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f1e3edc737813c75567863079b600774, ASSIGN}] 2023-07-23 23:06:09,443 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4f6a27ab2aae4be53ce220547c89f776, ASSIGN 2023-07-23 23:06:09,443 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f1e3edc737813c75567863079b600774, ASSIGN 2023-07-23 23:06:09,445 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4f6a27ab2aae4be53ce220547c89f776, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1690153558819; forceNewPlan=false, retain=false 2023-07-23 23:06:09,445 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f1e3edc737813c75567863079b600774, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34863,1690153558866; forceNewPlan=false, retain=false 2023-07-23 23:06:09,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 23:06:09,595 INFO [jenkins-hbase4:43049] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 23:06:09,597 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4f6a27ab2aae4be53ce220547c89f776, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:09,597 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=f1e3edc737813c75567863079b600774, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:09,597 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690153569597"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153569597"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153569597"}]},"ts":"1690153569597"} 2023-07-23 23:06:09,597 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690153569597"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153569597"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153569597"}]},"ts":"1690153569597"} 2023-07-23 23:06:09,600 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 4f6a27ab2aae4be53ce220547c89f776, server=jenkins-hbase4.apache.org,38881,1690153558819}] 2023-07-23 23:06:09,602 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure f1e3edc737813c75567863079b600774, server=jenkins-hbase4.apache.org,34863,1690153558866}] 2023-07-23 23:06:09,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776. 2023-07-23 23:06:09,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4f6a27ab2aae4be53ce220547c89f776, NAME => 'testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 23:06:09,763 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774. 2023-07-23 23:06:09,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776. service=AccessControlService 2023-07-23 23:06:09,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f1e3edc737813c75567863079b600774, NAME => 'testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 23:06:09,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 23:06:09,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774. service=AccessControlService 2023-07-23 23:06:09,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 4f6a27ab2aae4be53ce220547c89f776 2023-07-23 23:06:09,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:06:09,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 23:06:09,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4f6a27ab2aae4be53ce220547c89f776 2023-07-23 23:06:09,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4f6a27ab2aae4be53ce220547c89f776 2023-07-23 23:06:09,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName f1e3edc737813c75567863079b600774 2023-07-23 23:06:09,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:06:09,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f1e3edc737813c75567863079b600774 2023-07-23 23:06:09,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f1e3edc737813c75567863079b600774 2023-07-23 23:06:09,773 INFO [StoreOpener-4f6a27ab2aae4be53ce220547c89f776-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4f6a27ab2aae4be53ce220547c89f776 2023-07-23 23:06:09,773 INFO [StoreOpener-f1e3edc737813c75567863079b600774-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f1e3edc737813c75567863079b600774 2023-07-23 23:06:09,776 DEBUG [StoreOpener-4f6a27ab2aae4be53ce220547c89f776-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportWithTargetName/4f6a27ab2aae4be53ce220547c89f776/cf 2023-07-23 23:06:09,776 DEBUG [StoreOpener-f1e3edc737813c75567863079b600774-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportWithTargetName/f1e3edc737813c75567863079b600774/cf 2023-07-23 23:06:09,776 DEBUG [StoreOpener-4f6a27ab2aae4be53ce220547c89f776-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportWithTargetName/4f6a27ab2aae4be53ce220547c89f776/cf 2023-07-23 23:06:09,776 DEBUG [StoreOpener-f1e3edc737813c75567863079b600774-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportWithTargetName/f1e3edc737813c75567863079b600774/cf 2023-07-23 23:06:09,781 INFO [StoreOpener-4f6a27ab2aae4be53ce220547c89f776-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4f6a27ab2aae4be53ce220547c89f776 columnFamilyName cf 2023-07-23 23:06:09,784 INFO [StoreOpener-4f6a27ab2aae4be53ce220547c89f776-1] regionserver.HStore(310): Store=4f6a27ab2aae4be53ce220547c89f776/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 23:06:09,781 INFO [StoreOpener-f1e3edc737813c75567863079b600774-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f1e3edc737813c75567863079b600774 columnFamilyName cf 2023-07-23 23:06:09,791 INFO [StoreOpener-f1e3edc737813c75567863079b600774-1] regionserver.HStore(310): Store=f1e3edc737813c75567863079b600774/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 23:06:09,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportWithTargetName/4f6a27ab2aae4be53ce220547c89f776 2023-07-23 23:06:09,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportWithTargetName/4f6a27ab2aae4be53ce220547c89f776 2023-07-23 23:06:09,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportWithTargetName/f1e3edc737813c75567863079b600774 2023-07-23 23:06:09,798 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportWithTargetName/f1e3edc737813c75567863079b600774 2023-07-23 23:06:09,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4f6a27ab2aae4be53ce220547c89f776 2023-07-23 23:06:09,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f1e3edc737813c75567863079b600774 2023-07-23 23:06:09,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportWithTargetName/4f6a27ab2aae4be53ce220547c89f776/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 23:06:09,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4f6a27ab2aae4be53ce220547c89f776; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68852472, jitterRate=0.025981783866882324}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 23:06:09,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4f6a27ab2aae4be53ce220547c89f776: 2023-07-23 23:06:09,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776., pid=15, masterSystemTime=1690153569753 2023-07-23 23:06:09,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportWithTargetName/f1e3edc737813c75567863079b600774/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 23:06:09,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776. 2023-07-23 23:06:09,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776. 2023-07-23 23:06:09,822 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f1e3edc737813c75567863079b600774; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61706844, jitterRate=-0.08049637079238892}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 23:06:09,822 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f1e3edc737813c75567863079b600774: 2023-07-23 23:06:09,823 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=4f6a27ab2aae4be53ce220547c89f776, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:09,823 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690153569822"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690153569822"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690153569822"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690153569822"}]},"ts":"1690153569822"} 2023-07-23 23:06:09,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774., pid=16, masterSystemTime=1690153569754 2023-07-23 23:06:09,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774. 2023-07-23 23:06:09,827 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774. 2023-07-23 23:06:09,828 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=f1e3edc737813c75567863079b600774, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:09,829 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690153569828"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690153569828"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690153569828"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690153569828"}]},"ts":"1690153569828"} 2023-07-23 23:06:09,831 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-23 23:06:09,832 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 4f6a27ab2aae4be53ce220547c89f776, server=jenkins-hbase4.apache.org,38881,1690153558819 in 226 msec 2023-07-23 23:06:09,834 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4f6a27ab2aae4be53ce220547c89f776, ASSIGN in 392 msec 2023-07-23 23:06:09,838 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-23 23:06:09,839 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure f1e3edc737813c75567863079b600774, server=jenkins-hbase4.apache.org,34863,1690153558866 in 231 msec 2023-07-23 23:06:09,844 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-23 23:06:09,844 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f1e3edc737813c75567863079b600774, ASSIGN in 399 msec 2023-07-23 23:06:09,846 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 23:06:09,846 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153569846"}]},"ts":"1690153569846"} 2023-07-23 23:06:09,848 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-23 23:06:09,853 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 23:06:09,859 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-23 23:06:09,865 DEBUG [PEWorker-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:06:09,866 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35776, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:06:09,879 DEBUG [hconnection-0x75893a5f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:06:09,883 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45414, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-23 23:06:09,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 23:06:09,892 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34863] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-23 23:06:09,931 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 23:06:09,931 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 23:06:09,931 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 23:06:09,931 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-23 23:06:09,931 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 23:06:09,943 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 23:06:09,943 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 23:06:09,943 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 23:06:09,943 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 23:06:09,947 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 671 msec 2023-07-23 23:06:09,948 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-23 23:06:10,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-23 23:06:10,389 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-23 23:06:10,393 DEBUG [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-23 23:06:10,395 DEBUG [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776. 2023-07-23 23:06:10,397 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 23:06:10,424 DEBUG [hconnection-0x41a54ec6-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:06:10,430 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43696, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:06:10,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 23:06:10,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690153570446 (current time:1690153570446). 2023-07-23 23:06:10,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 23:06:10,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(139): Connect 0x62057f21 to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:06:10,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@382ab212, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:06:10,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:06:10,463 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40396, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:06:10,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62057f21 to 127.0.0.1:58893 2023-07-23 23:06:10,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:06:10,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(139): Connect 0x45f03d17 to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:06:10,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f45785b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:06:10,575 DEBUG [hconnection-0x3f9dc66b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:06:10,577 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:06:10,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:06:10,584 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:06:10,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45f03d17 to 127.0.0.1:58893 2023-07-23 23:06:10,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:06:10,585 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-23 23:06:10,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 23:06:10,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 23:06:10,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 23:06:10,637 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 23:06:10,638 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690154170638 2023-07-23 23:06:10,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 23:06:10,643 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-23 23:06:10,645 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 23:06:10,650 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 23:06:10,650 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 23:06:10,650 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 23:06:10,651 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 17 msec 2023-07-23 23:06:10,652 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 23:06:10,653 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690154170653 2023-07-23 23:06:10,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,694 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-23 23:06:10,694 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:06:10,695 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-23 23:06:10,695 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-23 23:06:10,696 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,696 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,702 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:10,702 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:10,702 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:10,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:10,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:10,702 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:10,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:10,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:10,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:10,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:10,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,704 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,704 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-23 23:06:10,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-23 23:06:10,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,705 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 23:06:10,705 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:10,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,705 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 23:06:10,705 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:10,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-23 23:06:10,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,706 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:10,706 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 23:06:10,707 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 23:06:10,708 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,708 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,708 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,709 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 23:06:10,709 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 23:06:10,709 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 23:06:10,709 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:06:10,709 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:06:10,710 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 23:06:10,710 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 23:06:10,710 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-23 23:06:10,709 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:06:10,710 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39259,1690153558742' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-23 23:06:10,711 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 23:06:10,711 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-23 23:06:10,710 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-23 23:06:10,711 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34863,1690153558866' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-23 23:06:10,711 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1690153558819' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-23 23:06:10,713 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,714 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,714 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,714 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,714 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:10,714 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:06:10,714 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:10,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:10,715 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:10,715 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:10,715 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:06:10,715 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:06:10,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:10,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:10,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:10,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:10,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:10,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:10,718 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34863,1690153558866' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-23 23:06:10,718 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b0ae6c4[Count = 1] remaining members to acquire global barrier 2023-07-23 23:06:10,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:10,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:10,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:10,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:10,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:10,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:10,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:10,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:10,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:10,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1690153558819' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-23 23:06:10,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7b0ae6c4[Count = 0] remaining members to acquire global barrier 2023-07-23 23:06:10,721 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-23 23:06:10,721 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,723 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,723 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,723 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,723 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:10,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,723 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 23:06:10,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,724 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-23 23:06:10,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,724 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:10,724 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39259,1690153558742' in zk 2023-07-23 23:06:10,724 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 23:06:10,724 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 23:06:10,724 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 23:06:10,725 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 23:06:10,725 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 23:06:10,725 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 23:06:10,725 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 23:06:10,725 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776. 2023-07-23 23:06:10,725 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774. 2023-07-23 23:06:10,726 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774. started... 2023-07-23 23:06:10,726 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776. started... 2023-07-23 23:06:10,728 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 23:06:10,728 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:06:10,728 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-23 23:06:10,730 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f1e3edc737813c75567863079b600774: 2023-07-23 23:06:10,730 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4f6a27ab2aae4be53ce220547c89f776: 2023-07-23 23:06:10,731 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,731 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,736 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 23:06:10,736 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 23:06:10,739 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 23:06:10,739 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 23:06:10,750 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:06:10,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 23:06:10,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 23:06:10,755 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 23:06:10,778 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774. completed. 2023-07-23 23:06:10,778 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774. 2023-07-23 23:06:10,779 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 23:06:10,779 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 23:06:10,779 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:10,779 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-23 23:06:10,779 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34863,1690153558866' in zk 2023-07-23 23:06:10,783 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:10,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:10,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:10,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:10,783 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 23:06:10,783 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:06:10,783 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-23 23:06:10,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:10,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:10,793 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776. completed. 2023-07-23 23:06:10,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,793 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776. 2023-07-23 23:06:10,794 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 23:06:10,794 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 23:06:10,794 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:10,794 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-23 23:06:10,794 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38881,1690153558819' in zk 2023-07-23 23:06:10,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:10,797 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:10,797 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 23:06:10,797 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:06:10,797 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-23 23:06:10,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:10,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:10,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:10,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:10,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:10,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:10,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34863,1690153558866': 2023-07-23 23:06:10,803 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34863,1690153558866' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-23 23:06:10,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:10,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:10,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:10,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:10,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:10,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:10,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:10,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:10,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:10,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:10,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:10,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:10,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,38881,1690153558819': 2023-07-23 23:06:10,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1690153558819' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-23 23:06:10,809 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-23 23:06:10,809 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 23:06:10,809 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 23:06:10,809 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,809 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 23:06:10,813 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,813 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,813 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,813 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:10,813 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,813 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:10,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,813 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:10,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:10,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:10,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:10,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:10,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:10,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:10,814 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:10,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:10,814 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:10,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:10,815 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:10,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,820 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:10,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:10,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:10,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:10,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:10,822 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:10,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:10,823 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:10,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,823 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:10,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:10,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:10,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:10,837 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:10,837 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,837 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:10,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:10,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:10,838 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:10,837 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:10,837 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:10,838 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:10,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:10,838 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,838 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:10,838 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-23 23:06:10,838 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,838 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:10,838 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:10,838 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:10,838 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:10,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:10,838 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 23:06:10,838 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:06:10,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:10,838 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:10,839 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:10,839 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,839 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:10,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:10,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:10,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:10,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:10,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:10,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-23 23:06:10,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,871 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:10,955 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:06:10,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 23:06:10,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 23:06:10,957 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 23:06:10,999 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-23 23:06:11,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:11,000 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:11,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690153570643Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1690153570868 (+225 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1690153570868Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1690153570869 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1690153570890 (+21 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1690153570917 (+27 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690153570999 (+82 ms) 2023-07-23 23:06:11,003 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 23:06:11,006 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 357 msec 2023-07-23 23:06:11,257 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:06:11,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 23:06:11,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 23:06:11,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 23:06:11,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34863] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 23:06:11,282 DEBUG [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-23 23:06:11,282 DEBUG [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776. 2023-07-23 23:06:11,282 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 23:06:11,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 23:06:11,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690153571296 (current time:1690153571296). 2023-07-23 23:06:11,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 23:06:11,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(139): Connect 0x5dcacb72 to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:06:11,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7214723b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:06:11,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:06:11,308 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:06:11,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5dcacb72 to 127.0.0.1:58893 2023-07-23 23:06:11,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:06:11,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(139): Connect 0x45679adf to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:06:11,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e7d485a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:06:11,317 DEBUG [hconnection-0x1f296e04-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:06:11,319 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:06:11,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:06:11,325 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43712, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:06:11,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45679adf to 127.0.0.1:58893 2023-07-23 23:06:11,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:06:11,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-23 23:06:11,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 23:06:11,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 23:06:11,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 23:06:11,331 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 23:06:11,332 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690154171332 2023-07-23 23:06:11,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-23 23:06:11,332 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-23 23:06:11,333 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 23:06:11,333 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 23:06:11,334 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-23 23:06:11,334 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 23:06:11,336 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 5 msec 2023-07-23 23:06:11,337 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 23:06:11,338 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690154171338 2023-07-23 23:06:11,353 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-23 23:06:11,353 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-23 23:06:11,353 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:06:11,353 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-23 23:06:11,354 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-23 23:06:11,354 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,354 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,356 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:11,356 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:11,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:11,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:11,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:11,356 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:11,356 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:11,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:11,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:11,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:11,357 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:11,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,357 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:11,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,358 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:11,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,358 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,358 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 23:06:11,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-23 23:06:11,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-23 23:06:11,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-23 23:06:11,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,358 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 23:06:11,359 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 23:06:11,359 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-23 23:06:11,359 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-23 23:06:11,359 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 23:06:11,359 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:06:11,360 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 23:06:11,360 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-23 23:06:11,360 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-23 23:06:11,360 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 23:06:11,360 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-23 23:06:11,360 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:06:11,360 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-23 23:06:11,361 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 23:06:11,361 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-23 23:06:11,361 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39259,1690153558742' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-23 23:06:11,361 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34863,1690153558866' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-23 23:06:11,361 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:06:11,362 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-23 23:06:11,362 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-23 23:06:11,362 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1690153558819' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-23 23:06:11,364 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,365 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:11,365 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,365 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:11,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:11,365 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,365 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:06:11,365 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:11,365 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:11,365 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:06:11,366 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,366 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:06:11,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:11,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:11,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 23:06:11,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:11,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:11,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:11,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:11,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1690153558819' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-23 23:06:11,368 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a036f09[Count = 1] remaining members to acquire global barrier 2023-07-23 23:06:11,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:11,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:11,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:11,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:11,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:11,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 23:06:11,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:11,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:11,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:11,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:11,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34863,1690153558866' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-23 23:06:11,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1a036f09[Count = 0] remaining members to acquire global barrier 2023-07-23 23:06:11,370 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-23 23:06:11,370 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,377 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,377 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,377 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,377 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 23:06:11,377 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:11,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,377 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 23:06:11,377 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776. 2023-07-23 23:06:11,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,377 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776. started... 2023-07-23 23:06:11,377 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:11,377 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 23:06:11,377 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 23:06:11,377 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 23:06:11,377 INFO [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4f6a27ab2aae4be53ce220547c89f776 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-23 23:06:11,378 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-23 23:06:11,377 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-23 23:06:11,378 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39259,1690153558742' in zk 2023-07-23 23:06:11,378 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 23:06:11,378 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774. 2023-07-23 23:06:11,378 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 23:06:11,378 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774. started... 2023-07-23 23:06:11,378 INFO [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f1e3edc737813c75567863079b600774 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-23 23:06:11,380 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 23:06:11,380 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:06:11,380 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-23 23:06:11,433 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:06:11,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 23:06:11,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 23:06:11,435 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 23:06:11,508 INFO [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230723542a2a1054ff43a4a0f0d9fd9af327a8 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230723542a2a1054ff43a4a0f0d9fd9af327a8 2023-07-23 23:06:11,508 INFO [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230723b07e86c9d40e487b8dd5a7b35d3f43b0 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230723b07e86c9d40e487b8dd5a7b35d3f43b0 2023-07-23 23:06:11,545 INFO [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportWithTargetName/4f6a27ab2aae4be53ce220547c89f776/.tmp/cf/ecc6f49935bc461daa16d99641d84a52 2023-07-23 23:06:11,552 INFO [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportWithTargetName/f1e3edc737813c75567863079b600774/.tmp/cf/e787af1cc7314a46b8ec559c6bae1db2 2023-07-23 23:06:11,562 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportWithTargetName/4f6a27ab2aae4be53ce220547c89f776/.tmp/cf/ecc6f49935bc461daa16d99641d84a52 as hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportWithTargetName/4f6a27ab2aae4be53ce220547c89f776/cf/ecc6f49935bc461daa16d99641d84a52 2023-07-23 23:06:11,565 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportWithTargetName/f1e3edc737813c75567863079b600774/.tmp/cf/e787af1cc7314a46b8ec559c6bae1db2 as hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportWithTargetName/f1e3edc737813c75567863079b600774/cf/e787af1cc7314a46b8ec559c6bae1db2 2023-07-23 23:06:11,575 INFO [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportWithTargetName/4f6a27ab2aae4be53ce220547c89f776/cf/ecc6f49935bc461daa16d99641d84a52, entries=3, sequenceid=6, filesize=5.4 K 2023-07-23 23:06:11,578 INFO [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportWithTargetName/f1e3edc737813c75567863079b600774/cf/e787af1cc7314a46b8ec559c6bae1db2, entries=47, sequenceid=6, filesize=12.8 K 2023-07-23 23:06:11,579 INFO [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 4f6a27ab2aae4be53ce220547c89f776 in 202ms, sequenceid=6, compaction requested=false 2023-07-23 23:06:11,580 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-23 23:06:11,581 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4f6a27ab2aae4be53ce220547c89f776: 2023-07-23 23:06:11,581 INFO [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for f1e3edc737813c75567863079b600774 in 203ms, sequenceid=6, compaction requested=false 2023-07-23 23:06:11,582 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f1e3edc737813c75567863079b600774: 2023-07-23 23:06:11,583 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-23 23:06:11,583 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-23 23:06:11,583 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 23:06:11,583 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 23:06:11,583 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportWithTargetName/f1e3edc737813c75567863079b600774/cf/e787af1cc7314a46b8ec559c6bae1db2] hfiles 2023-07-23 23:06:11,583 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportWithTargetName/4f6a27ab2aae4be53ce220547c89f776/cf/ecc6f49935bc461daa16d99641d84a52] hfiles 2023-07-23 23:06:11,583 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportWithTargetName/f1e3edc737813c75567863079b600774/cf/e787af1cc7314a46b8ec559c6bae1db2 for snapshot=snaptb0-testExportWithTargetName 2023-07-23 23:06:11,583 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportWithTargetName/4f6a27ab2aae4be53ce220547c89f776/cf/ecc6f49935bc461daa16d99641d84a52 for snapshot=snaptb0-testExportWithTargetName 2023-07-23 23:06:11,635 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:06:11,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 23:06:11,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 23:06:11,638 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 23:06:11,639 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776. completed. 2023-07-23 23:06:11,639 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776. 2023-07-23 23:06:11,639 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 23:06:11,639 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 23:06:11,639 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:11,639 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-23 23:06:11,639 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38881,1690153558819' in zk 2023-07-23 23:06:11,641 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 23:06:11,641 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:11,641 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:06:11,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:11,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:11,641 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-23 23:06:11,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:11,645 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774. completed. 2023-07-23 23:06:11,645 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774. 2023-07-23 23:06:11,645 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 23:06:11,645 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 23:06:11,645 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:11,645 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-23 23:06:11,645 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34863,1690153558866' in zk 2023-07-23 23:06:11,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:11,649 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:11,649 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-23 23:06:11,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:11,649 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:06:11,649 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-23 23:06:11,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 23:06:11,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:11,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:11,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:11,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:11,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 23:06:11,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:11,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:11,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:11,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,38881,1690153558819': 2023-07-23 23:06:11,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1690153558819' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-23 23:06:11,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:11,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:11,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:11,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:11,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:11,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 23:06:11,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:11,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:11,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:11,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:11,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 23:06:11,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:11,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:11,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:11,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,34863,1690153558866': 2023-07-23 23:06:11,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34863,1690153558866' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-23 23:06:11,659 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-23 23:06:11,660 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 23:06:11,660 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 23:06:11,660 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-23 23:06:11,660 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 23:06:11,663 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,663 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,663 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:11,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,663 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:11,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:11,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:11,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:11,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:11,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,665 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:11,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,665 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:11,666 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,666 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,666 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:11,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:11,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:11,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,666 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:11,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:11,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:11,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:11,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 23:06:11,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:11,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 23:06:11,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:11,669 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:11,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:11,669 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:11,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:11,670 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:11,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:11,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-23 23:06:11,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:11,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:11,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:11,684 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:11,684 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:11,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:11,684 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:11,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:11,685 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:06:11,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:11,685 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-23 23:06:11,684 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,684 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:11,686 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:11,686 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-23 23:06:11,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:11,685 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:11,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-23 23:06:11,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 23:06:11,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:11,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:11,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:11,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:11,687 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName because node does not exist (not an error) 2023-07-23 23:06:11,685 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:11,686 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:11,686 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:11,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:11,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:11,687 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,687 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:11,687 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:11,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:11,687 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:11,687 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:11,688 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,688 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230723b07e86c9d40e487b8dd5a7b35d3f43b0, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230723542a2a1054ff43a4a0f0d9fd9af327a8] mob files 2023-07-23 23:06:11,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230723b07e86c9d40e487b8dd5a7b35d3f43b0 2023-07-23 23:06:11,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230723542a2a1054ff43a4a0f0d9fd9af327a8 2023-07-23 23:06:11,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-23 23:06:11,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-23 23:06:11,939 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:06:11,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 23:06:11,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-23 23:06:11,942 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-23 23:06:12,200 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-23 23:06:12,200 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-23 23:06:12,200 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-23 23:06:12,201 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690153571332Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1690153571716 (+384 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1690153571716Loading Region manifests for snaptb0-testExportWithTargetName at 1690153571716Writing data manifest for snaptb0-testExportWithTargetName at 1690153571724 (+8 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1690153571744 (+20 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690153572200 (+456 ms) 2023-07-23 23:06:12,203 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-23 23:06:12,206 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 870 msec 2023-07-23 23:06:12,442 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:06:12,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-23 23:06:12,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 23:06:12,446 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153572446 2023-07-23 23:06:12,447 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40459, tgtDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153572446, rawTgtDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153572446, srcFsUri=hdfs://localhost:40459, srcDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f 2023-07-23 23:06:12,496 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40459, inputRoot=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f 2023-07-23 23:06:12,496 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-127068372_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153572446, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153572446/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-23 23:06:12,496 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40459, inputRoot=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f, snapshotDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-23 23:06:12,516 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153572446/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-23 23:06:12,611 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:12,611 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:12,612 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:12,613 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:13,702 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/hadoop-5356117304773072896.jar 2023-07-23 23:06:13,703 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:13,704 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:13,802 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/hadoop-4457949373369399208.jar 2023-07-23 23:06:13,803 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:13,803 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:13,804 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:13,805 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:13,805 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:13,806 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:13,806 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 23:06:13,808 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 23:06:13,808 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 23:06:13,809 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 23:06:13,809 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 23:06:13,810 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 23:06:13,810 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 23:06:13,811 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 23:06:13,812 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 23:06:13,813 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 23:06:13,820 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:06:13,820 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:06:13,821 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 23:06:13,821 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:06:13,822 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:06:13,823 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 23:06:13,823 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 23:06:15,280 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 23:06:15,656 WARN [Listener at jenkins-hbase4.apache.org/42491] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 23:06:15,663 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-23 23:06:15,672 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-23 23:06:16,283 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 23:06:16,284 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 23:06:17,031 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0001_000001 (auth:SIMPLE) 2023-07-23 23:06:22,096 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0001_000001 (auth:SIMPLE) 2023-07-23 23:06:24,404 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0001_000001 (auth:SIMPLE) 2023-07-23 23:06:27,822 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0001_000001 (auth:SIMPLE) 2023-07-23 23:06:29,686 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 23:06:29,688 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 23:06:29,700 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-23 23:06:29,700 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 23:06:29,701 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 23:06:29,701 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2080736097_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-23 23:06:29,701 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-23 23:06:29,701 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-23 23:06:29,701 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2080736097_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153572446/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153572446/.hbase-snapshot/testExportWithTargetName 2023-07-23 23:06:29,702 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153572446/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-23 23:06:29,702 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153572446/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-23 23:06:29,716 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-23 23:06:29,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-23 23:06:29,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-23 23:06:29,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-23 23:06:29,735 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153589735"}]},"ts":"1690153589735"} 2023-07-23 23:06:29,737 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-23 23:06:29,739 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-23 23:06:29,744 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4f6a27ab2aae4be53ce220547c89f776, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f1e3edc737813c75567863079b600774, UNASSIGN}] 2023-07-23 23:06:29,746 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4f6a27ab2aae4be53ce220547c89f776, UNASSIGN 2023-07-23 23:06:29,746 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f1e3edc737813c75567863079b600774, UNASSIGN 2023-07-23 23:06:29,747 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=4f6a27ab2aae4be53ce220547c89f776, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:29,747 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=f1e3edc737813c75567863079b600774, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:29,747 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690153589747"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153589747"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153589747"}]},"ts":"1690153589747"} 2023-07-23 23:06:29,747 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690153589747"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153589747"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153589747"}]},"ts":"1690153589747"} 2023-07-23 23:06:29,752 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 4f6a27ab2aae4be53ce220547c89f776, server=jenkins-hbase4.apache.org,38881,1690153558819}] 2023-07-23 23:06:29,752 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure f1e3edc737813c75567863079b600774, server=jenkins-hbase4.apache.org,34863,1690153558866}] 2023-07-23 23:06:29,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-23 23:06:29,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4f6a27ab2aae4be53ce220547c89f776 2023-07-23 23:06:29,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f1e3edc737813c75567863079b600774 2023-07-23 23:06:29,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4f6a27ab2aae4be53ce220547c89f776, disabling compactions & flushes 2023-07-23 23:06:29,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f1e3edc737813c75567863079b600774, disabling compactions & flushes 2023-07-23 23:06:29,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776. 2023-07-23 23:06:29,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774. 2023-07-23 23:06:29,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776. 2023-07-23 23:06:29,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774. 2023-07-23 23:06:29,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776. after waiting 0 ms 2023-07-23 23:06:29,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774. after waiting 0 ms 2023-07-23 23:06:29,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776. 2023-07-23 23:06:29,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774. 2023-07-23 23:06:29,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportWithTargetName/f1e3edc737813c75567863079b600774/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 23:06:29,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:06:29,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportWithTargetName/4f6a27ab2aae4be53ce220547c89f776/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 23:06:29,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774. 2023-07-23 23:06:29,934 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f1e3edc737813c75567863079b600774: 2023-07-23 23:06:29,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:06:29,936 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776. 2023-07-23 23:06:29,936 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4f6a27ab2aae4be53ce220547c89f776: 2023-07-23 23:06:29,939 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f1e3edc737813c75567863079b600774 2023-07-23 23:06:29,939 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=f1e3edc737813c75567863079b600774, regionState=CLOSED 2023-07-23 23:06:29,940 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690153589939"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153589939"}]},"ts":"1690153589939"} 2023-07-23 23:06:29,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4f6a27ab2aae4be53ce220547c89f776 2023-07-23 23:06:29,941 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=4f6a27ab2aae4be53ce220547c89f776, regionState=CLOSED 2023-07-23 23:06:29,941 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690153589941"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153589941"}]},"ts":"1690153589941"} 2023-07-23 23:06:29,947 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-23 23:06:29,947 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure f1e3edc737813c75567863079b600774, server=jenkins-hbase4.apache.org,34863,1690153558866 in 190 msec 2023-07-23 23:06:29,948 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-23 23:06:29,948 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 4f6a27ab2aae4be53ce220547c89f776, server=jenkins-hbase4.apache.org,38881,1690153558819 in 194 msec 2023-07-23 23:06:29,949 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f1e3edc737813c75567863079b600774, UNASSIGN in 204 msec 2023-07-23 23:06:29,950 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-23 23:06:29,951 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=4f6a27ab2aae4be53ce220547c89f776, UNASSIGN in 205 msec 2023-07-23 23:06:29,952 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153589952"}]},"ts":"1690153589952"} 2023-07-23 23:06:29,953 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-23 23:06:29,955 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-23 23:06:29,958 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 232 msec 2023-07-23 23:06:30,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-23 23:06:30,039 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-23 23:06:30,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-23 23:06:30,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 23:06:30,057 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 23:06:30,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-23 23:06:30,060 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 23:06:30,064 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34863] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-23 23:06:30,068 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 23:06:30,068 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 23:06:30,068 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 23:06:30,068 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 23:06:30,069 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-23 23:06:30,069 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-23 23:06:30,069 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-23 23:06:30,069 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-23 23:06:30,070 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 23:06:30,070 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:06:30,070 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 23:06:30,070 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 23:06:30,070 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:06:30,070 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-23 23:06:30,071 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:06:30,070 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:06:30,074 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportWithTargetName/4f6a27ab2aae4be53ce220547c89f776 2023-07-23 23:06:30,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-23 23:06:30,074 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportWithTargetName/f1e3edc737813c75567863079b600774 2023-07-23 23:06:30,078 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportWithTargetName/f1e3edc737813c75567863079b600774/cf, FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportWithTargetName/f1e3edc737813c75567863079b600774/recovered.edits] 2023-07-23 23:06:30,078 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportWithTargetName/4f6a27ab2aae4be53ce220547c89f776/cf, FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportWithTargetName/4f6a27ab2aae4be53ce220547c89f776/recovered.edits] 2023-07-23 23:06:30,086 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportWithTargetName/f1e3edc737813c75567863079b600774/cf/e787af1cc7314a46b8ec559c6bae1db2 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportWithTargetName/f1e3edc737813c75567863079b600774/cf/e787af1cc7314a46b8ec559c6bae1db2 2023-07-23 23:06:30,086 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportWithTargetName/4f6a27ab2aae4be53ce220547c89f776/cf/ecc6f49935bc461daa16d99641d84a52 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportWithTargetName/4f6a27ab2aae4be53ce220547c89f776/cf/ecc6f49935bc461daa16d99641d84a52 2023-07-23 23:06:30,091 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportWithTargetName/4f6a27ab2aae4be53ce220547c89f776/recovered.edits/9.seqid to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportWithTargetName/4f6a27ab2aae4be53ce220547c89f776/recovered.edits/9.seqid 2023-07-23 23:06:30,092 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportWithTargetName/4f6a27ab2aae4be53ce220547c89f776 2023-07-23 23:06:30,093 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportWithTargetName/f1e3edc737813c75567863079b600774/recovered.edits/9.seqid to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportWithTargetName/f1e3edc737813c75567863079b600774/recovered.edits/9.seqid 2023-07-23 23:06:30,094 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportWithTargetName/f1e3edc737813c75567863079b600774 2023-07-23 23:06:30,094 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-23 23:06:30,094 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-23 23:06:30,095 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-23 23:06:30,099 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230723b07e86c9d40e487b8dd5a7b35d3f43b0 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b20230723b07e86c9d40e487b8dd5a7b35d3f43b0 2023-07-23 23:06:30,101 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230723542a2a1054ff43a4a0f0d9fd9af327a8 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230723542a2a1054ff43a4a0f0d9fd9af327a8 2023-07-23 23:06:30,101 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-23 23:06:30,106 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 23:06:30,131 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-23 23:06:30,134 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-23 23:06:30,136 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 23:06:30,136 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-23 23:06:30,136 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690153590136"}]},"ts":"9223372036854775807"} 2023-07-23 23:06:30,136 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690153590136"}]},"ts":"9223372036854775807"} 2023-07-23 23:06:30,141 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 23:06:30,141 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4f6a27ab2aae4be53ce220547c89f776, NAME => 'testtb-testExportWithTargetName,,1690153569271.4f6a27ab2aae4be53ce220547c89f776.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f1e3edc737813c75567863079b600774, NAME => 'testtb-testExportWithTargetName,1,1690153569271.f1e3edc737813c75567863079b600774.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 23:06:30,141 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-23 23:06:30,141 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690153590141"}]},"ts":"9223372036854775807"} 2023-07-23 23:06:30,144 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-23 23:06:30,147 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-23 23:06:30,150 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 101 msec 2023-07-23 23:06:30,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-23 23:06:30,179 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-23 23:06:30,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-23 23:06:30,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-23 23:06:30,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-23 23:06:30,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-23 23:06:30,275 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=751 (was 706) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/cluster_115860c6-be70-9d94-b4d7-cb76015f80b3/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:43433 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/cluster_115860c6-be70-9d94-b4d7-cb76015f80b3/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5c344f42-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1211281215_1 at /127.0.0.1:53104 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/cluster_115860c6-be70-9d94-b4d7-cb76015f80b3/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1317 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/cluster_115860c6-be70-9d94-b4d7-cb76015f80b3/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/cluster_115860c6-be70-9d94-b4d7-cb76015f80b3/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/cluster_115860c6-be70-9d94-b4d7-cb76015f80b3/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5c344f42-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2080736097_17 at /127.0.0.1:55810 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5c344f42-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:46597 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2080736097_17 at /127.0.0.1:47042 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2080736097_17 at /127.0.0.1:53126 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5c344f42-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=918 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=258 (was 135) - SystemLoadAverage LEAK? -, ProcessCount=178 (was 172) - ProcessCount LEAK? -, AvailableMemoryMB=5921 (was 7816) 2023-07-23 23:06:30,275 WARN [Listener at jenkins-hbase4.apache.org/42491] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-23 23:06:30,301 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=751, OpenFileDescriptor=918, MaxFileDescriptor=60000, SystemLoadAverage=258, ProcessCount=178, AvailableMemoryMB=5919 2023-07-23 23:06:30,301 WARN [Listener at jenkins-hbase4.apache.org/42491] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-23 23:06:30,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-23 23:06:30,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-23 23:06:30,311 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 23:06:30,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-23 23:06:30,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 23:06:30,322 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 23:06:30,325 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemState/b57266165cb03c80f3017a7b3dabeca6 2023-07-23 23:06:30,325 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemState/af255a9d31b2fb3634ddcfa474f60230 2023-07-23 23:06:30,326 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemState/af255a9d31b2fb3634ddcfa474f60230 empty. 2023-07-23 23:06:30,326 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemState/b57266165cb03c80f3017a7b3dabeca6 empty. 2023-07-23 23:06:30,326 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemState/b57266165cb03c80f3017a7b3dabeca6 2023-07-23 23:06:30,326 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemState/af255a9d31b2fb3634ddcfa474f60230 2023-07-23 23:06:30,327 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-23 23:06:30,344 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-23 23:06:30,346 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => b57266165cb03c80f3017a7b3dabeca6, NAME => 'testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp 2023-07-23 23:06:30,346 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => af255a9d31b2fb3634ddcfa474f60230, NAME => 'testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp 2023-07-23 23:06:30,410 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:06:30,410 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing af255a9d31b2fb3634ddcfa474f60230, disabling compactions & flushes 2023-07-23 23:06:30,410 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230. 2023-07-23 23:06:30,410 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230. 2023-07-23 23:06:30,410 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230. after waiting 0 ms 2023-07-23 23:06:30,410 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230. 2023-07-23 23:06:30,410 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230. 2023-07-23 23:06:30,410 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for af255a9d31b2fb3634ddcfa474f60230: 2023-07-23 23:06:30,418 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:06:30,420 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing b57266165cb03c80f3017a7b3dabeca6, disabling compactions & flushes 2023-07-23 23:06:30,420 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6. 2023-07-23 23:06:30,420 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6. 2023-07-23 23:06:30,420 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6. after waiting 0 ms 2023-07-23 23:06:30,420 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6. 2023-07-23 23:06:30,420 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6. 2023-07-23 23:06:30,420 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for b57266165cb03c80f3017a7b3dabeca6: 2023-07-23 23:06:30,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 23:06:30,424 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 23:06:30,425 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690153590425"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153590425"}]},"ts":"1690153590425"} 2023-07-23 23:06:30,425 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690153590425"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153590425"}]},"ts":"1690153590425"} 2023-07-23 23:06:30,428 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 23:06:30,430 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 23:06:30,430 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153590430"}]},"ts":"1690153590430"} 2023-07-23 23:06:30,439 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-23 23:06:30,443 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 23:06:30,444 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 23:06:30,444 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 23:06:30,444 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 23:06:30,444 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 23:06:30,444 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b57266165cb03c80f3017a7b3dabeca6, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=af255a9d31b2fb3634ddcfa474f60230, ASSIGN}] 2023-07-23 23:06:30,447 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b57266165cb03c80f3017a7b3dabeca6, ASSIGN 2023-07-23 23:06:30,447 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=af255a9d31b2fb3634ddcfa474f60230, ASSIGN 2023-07-23 23:06:30,448 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b57266165cb03c80f3017a7b3dabeca6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1690153558819; forceNewPlan=false, retain=false 2023-07-23 23:06:30,448 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=af255a9d31b2fb3634ddcfa474f60230, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34863,1690153558866; forceNewPlan=false, retain=false 2023-07-23 23:06:30,599 INFO [jenkins-hbase4:43049] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 23:06:30,602 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=b57266165cb03c80f3017a7b3dabeca6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:30,602 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=af255a9d31b2fb3634ddcfa474f60230, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:30,602 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690153590602"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153590602"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153590602"}]},"ts":"1690153590602"} 2023-07-23 23:06:30,603 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690153590602"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153590602"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153590602"}]},"ts":"1690153590602"} 2023-07-23 23:06:30,605 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure b57266165cb03c80f3017a7b3dabeca6, server=jenkins-hbase4.apache.org,38881,1690153558819}] 2023-07-23 23:06:30,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure af255a9d31b2fb3634ddcfa474f60230, server=jenkins-hbase4.apache.org,34863,1690153558866}] 2023-07-23 23:06:30,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 23:06:30,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6. 2023-07-23 23:06:30,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b57266165cb03c80f3017a7b3dabeca6, NAME => 'testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 23:06:30,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230. 2023-07-23 23:06:30,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6. service=AccessControlService 2023-07-23 23:06:30,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => af255a9d31b2fb3634ddcfa474f60230, NAME => 'testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 23:06:30,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 23:06:30,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState b57266165cb03c80f3017a7b3dabeca6 2023-07-23 23:06:30,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:06:30,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b57266165cb03c80f3017a7b3dabeca6 2023-07-23 23:06:30,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b57266165cb03c80f3017a7b3dabeca6 2023-07-23 23:06:30,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230. service=AccessControlService 2023-07-23 23:06:30,766 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 23:06:30,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState af255a9d31b2fb3634ddcfa474f60230 2023-07-23 23:06:30,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:06:30,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for af255a9d31b2fb3634ddcfa474f60230 2023-07-23 23:06:30,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for af255a9d31b2fb3634ddcfa474f60230 2023-07-23 23:06:30,767 INFO [StoreOpener-b57266165cb03c80f3017a7b3dabeca6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b57266165cb03c80f3017a7b3dabeca6 2023-07-23 23:06:30,767 INFO [StoreOpener-af255a9d31b2fb3634ddcfa474f60230-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region af255a9d31b2fb3634ddcfa474f60230 2023-07-23 23:06:30,768 DEBUG [StoreOpener-b57266165cb03c80f3017a7b3dabeca6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemState/b57266165cb03c80f3017a7b3dabeca6/cf 2023-07-23 23:06:30,769 DEBUG [StoreOpener-b57266165cb03c80f3017a7b3dabeca6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemState/b57266165cb03c80f3017a7b3dabeca6/cf 2023-07-23 23:06:30,769 DEBUG [StoreOpener-af255a9d31b2fb3634ddcfa474f60230-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemState/af255a9d31b2fb3634ddcfa474f60230/cf 2023-07-23 23:06:30,769 DEBUG [StoreOpener-af255a9d31b2fb3634ddcfa474f60230-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemState/af255a9d31b2fb3634ddcfa474f60230/cf 2023-07-23 23:06:30,769 INFO [StoreOpener-b57266165cb03c80f3017a7b3dabeca6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b57266165cb03c80f3017a7b3dabeca6 columnFamilyName cf 2023-07-23 23:06:30,769 INFO [StoreOpener-af255a9d31b2fb3634ddcfa474f60230-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region af255a9d31b2fb3634ddcfa474f60230 columnFamilyName cf 2023-07-23 23:06:30,771 INFO [StoreOpener-af255a9d31b2fb3634ddcfa474f60230-1] regionserver.HStore(310): Store=af255a9d31b2fb3634ddcfa474f60230/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 23:06:30,771 INFO [StoreOpener-b57266165cb03c80f3017a7b3dabeca6-1] regionserver.HStore(310): Store=b57266165cb03c80f3017a7b3dabeca6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 23:06:30,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemState/af255a9d31b2fb3634ddcfa474f60230 2023-07-23 23:06:30,773 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemState/b57266165cb03c80f3017a7b3dabeca6 2023-07-23 23:06:30,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemState/af255a9d31b2fb3634ddcfa474f60230 2023-07-23 23:06:30,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemState/b57266165cb03c80f3017a7b3dabeca6 2023-07-23 23:06:30,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b57266165cb03c80f3017a7b3dabeca6 2023-07-23 23:06:30,777 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for af255a9d31b2fb3634ddcfa474f60230 2023-07-23 23:06:30,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemState/b57266165cb03c80f3017a7b3dabeca6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 23:06:30,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemState/af255a9d31b2fb3634ddcfa474f60230/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 23:06:30,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b57266165cb03c80f3017a7b3dabeca6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61456776, jitterRate=-0.08422267436981201}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 23:06:30,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b57266165cb03c80f3017a7b3dabeca6: 2023-07-23 23:06:30,780 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened af255a9d31b2fb3634ddcfa474f60230; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65740733, jitterRate=-0.020386740565299988}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 23:06:30,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for af255a9d31b2fb3634ddcfa474f60230: 2023-07-23 23:06:30,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230., pid=31, masterSystemTime=1690153590762 2023-07-23 23:06:30,781 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6., pid=30, masterSystemTime=1690153590761 2023-07-23 23:06:30,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230. 2023-07-23 23:06:30,782 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230. 2023-07-23 23:06:30,783 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=af255a9d31b2fb3634ddcfa474f60230, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:30,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6. 2023-07-23 23:06:30,783 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6. 2023-07-23 23:06:30,783 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690153590783"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690153590783"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690153590783"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690153590783"}]},"ts":"1690153590783"} 2023-07-23 23:06:30,784 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=b57266165cb03c80f3017a7b3dabeca6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:30,785 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690153590784"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690153590784"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690153590784"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690153590784"}]},"ts":"1690153590784"} 2023-07-23 23:06:30,788 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-23 23:06:30,791 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure af255a9d31b2fb3634ddcfa474f60230, server=jenkins-hbase4.apache.org,34863,1690153558866 in 179 msec 2023-07-23 23:06:30,792 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-23 23:06:30,792 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure b57266165cb03c80f3017a7b3dabeca6, server=jenkins-hbase4.apache.org,38881,1690153558819 in 181 msec 2023-07-23 23:06:30,793 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=af255a9d31b2fb3634ddcfa474f60230, ASSIGN in 347 msec 2023-07-23 23:06:30,794 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-23 23:06:30,794 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b57266165cb03c80f3017a7b3dabeca6, ASSIGN in 348 msec 2023-07-23 23:06:30,795 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 23:06:30,796 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153590795"}]},"ts":"1690153590795"} 2023-07-23 23:06:30,797 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-23 23:06:30,799 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 23:06:30,800 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-23 23:06:30,802 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34863] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 23:06:30,803 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:06:30,803 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:06:30,803 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:06:30,803 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:06:30,805 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 23:06:30,805 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 23:06:30,805 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 23:06:30,805 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 23:06:30,807 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 500 msec 2023-07-23 23:06:30,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-23 23:06:30,923 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-23 23:06:30,926 DEBUG [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-23 23:06:30,926 DEBUG [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6. 2023-07-23 23:06:30,928 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 23:06:30,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 23:06:30,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690153590942 (current time:1690153590942). 2023-07-23 23:06:30,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 23:06:30,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(139): Connect 0x1e6b4b31 to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:06:30,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@280d2e4b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:06:30,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:06:30,952 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:06:30,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e6b4b31 to 127.0.0.1:58893 2023-07-23 23:06:30,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:06:30,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(139): Connect 0x025e467a to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:06:30,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46a8a7c3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:06:30,961 DEBUG [hconnection-0x796a62b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:06:30,963 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:06:30,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:06:30,969 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35566, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:06:30,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x025e467a to 127.0.0.1:58893 2023-07-23 23:06:30,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:06:30,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 23:06:30,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 23:06:30,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 23:06:30,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 23:06:30,975 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 23:06:30,976 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690154190976 2023-07-23 23:06:30,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 23:06:30,976 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-23 23:06:30,977 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 23:06:30,978 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 23:06:30,978 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 23:06:30,979 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 23:06:30,981 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-23 23:06:30,981 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 23:06:30,982 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690154190982 2023-07-23 23:06:30,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:30,993 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-23 23:06:30,993 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:06:30,994 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-23 23:06:30,994 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-23 23:06:30,995 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:30,995 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:30,997 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:30,998 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:30,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:30,998 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:30,997 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:30,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:30,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:30,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:30,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:30,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:30,998 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:30,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:30,998 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:30,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:30,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:30,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:30,999 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:30,999 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 23:06:30,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:30,999 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:30,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-23 23:06:30,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:30,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-23 23:06:30,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:30,999 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 23:06:30,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-23 23:06:30,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:30,999 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 23:06:31,000 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 23:06:31,000 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,000 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 23:06:31,000 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,000 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:06:31,000 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 23:06:31,002 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:06:31,000 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,003 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 23:06:31,003 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-23 23:06:31,002 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 23:06:31,003 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-23 23:06:31,003 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1690153558819' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-23 23:06:31,003 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 23:06:31,003 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:06:31,003 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34863,1690153558866' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-23 23:06:31,004 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 23:06:31,004 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-23 23:06:31,004 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39259,1690153558742' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-23 23:06:31,009 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,009 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,009 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:31,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:31,009 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,010 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,010 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,010 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:31,010 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:06:31,010 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:06:31,010 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,010 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:06:31,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:31,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:31,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:31,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1690153558819' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-23 23:06:31,012 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54a30d6[Count = 1] remaining members to acquire global barrier 2023-07-23 23:06:31,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:31,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:31,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:31,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:31,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:31,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:31,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34863,1690153558866' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-23 23:06:31,014 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54a30d6[Count = 0] remaining members to acquire global barrier 2023-07-23 23:06:31,014 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 23:06:31,014 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,015 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,015 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,015 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,016 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,016 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 23:06:31,016 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 23:06:31,016 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-23 23:06:31,016 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39259,1690153558742' in zk 2023-07-23 23:06:31,016 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 23:06:31,016 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,016 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 23:06:31,016 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 23:06:31,016 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 23:06:31,016 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230. 2023-07-23 23:06:31,016 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 23:06:31,016 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6. 2023-07-23 23:06:31,016 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 23:06:31,016 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6. started... 2023-07-23 23:06:31,016 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230. started... 2023-07-23 23:06:31,017 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b57266165cb03c80f3017a7b3dabeca6: 2023-07-23 23:06:31,018 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for af255a9d31b2fb3634ddcfa474f60230: 2023-07-23 23:06:31,018 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,018 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 23:06:31,018 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 23:06:31,018 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,018 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 23:06:31,018 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 23:06:31,018 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 23:06:31,018 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:06:31,018 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-23 23:06:31,043 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230. completed. 2023-07-23 23:06:31,043 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230. 2023-07-23 23:06:31,043 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 23:06:31,043 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 23:06:31,043 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,043 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-23 23:06:31,043 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34863,1690153558866' in zk 2023-07-23 23:06:31,045 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 23:06:31,045 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:06:31,045 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-23 23:06:31,047 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6. completed. 2023-07-23 23:06:31,047 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6. 2023-07-23 23:06:31,047 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,047 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 23:06:31,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:31,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:31,047 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 23:06:31,047 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,047 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-23 23:06:31,047 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38881,1690153558819' in zk 2023-07-23 23:06:31,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:31,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:31,049 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,049 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 23:06:31,049 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:06:31,049 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-23 23:06:31,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:31,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:31,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:31,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34863,1690153558866': 2023-07-23 23:06:31,053 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34863,1690153558866' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 23:06:31,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:31,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:31,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:31,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:31,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:31,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:31,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:31,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,38881,1690153558819': 2023-07-23 23:06:31,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1690153558819' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 23:06:31,058 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-23 23:06:31,058 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 23:06:31,058 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 23:06:31,058 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,059 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 23:06:31,060 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,060 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,060 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:31,060 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:31,060 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,060 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:31,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:31,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:31,061 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:31,061 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:31,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:31,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:31,062 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,062 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:31,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:31,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,064 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:31,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:31,065 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,065 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:31,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,069 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,069 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,069 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:31,069 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:31,069 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:31,069 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,069 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:06:31,069 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:31,069 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,070 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:31,070 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,069 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:31,071 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-23 23:06:31,069 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:31,069 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:31,071 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:31,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:31,071 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 23:06:31,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:31,071 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:31,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:31,071 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,071 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:31,071 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:31,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:31,071 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:31,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:31,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:31,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:31,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-23 23:06:31,078 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:06:31,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 23:06:31,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 23:06:31,079 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 23:06:31,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,102 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,125 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-23 23:06:31,125 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,126 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:31,126 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690153590976Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1690153591080 (+104 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1690153591080Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1690153591080Writing data manifest for emptySnaptb0-testExportFileSystemState at 1690153591084 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1690153591095 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690153591125 (+30 ms) 2023-07-23 23:06:31,128 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 23:06:31,130 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 151 msec 2023-07-23 23:06:31,279 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:06:31,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 23:06:31,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 23:06:31,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 23:06:31,285 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34863] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 23:06:31,289 DEBUG [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-23 23:06:31,289 DEBUG [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6. 2023-07-23 23:06:31,289 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 23:06:31,299 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-23 23:06:31,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 23:06:31,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690153591300 (current time:1690153591300). 2023-07-23 23:06:31,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 23:06:31,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(139): Connect 0x55eea13b to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:06:31,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5854b43c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:06:31,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:06:31,314 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33666, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:06:31,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55eea13b to 127.0.0.1:58893 2023-07-23 23:06:31,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:06:31,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(139): Connect 0x2f0b8a1c to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:06:31,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e38f016, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:06:31,324 DEBUG [hconnection-0x45797a64-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:06:31,325 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33670, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:06:31,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:06:31,330 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35572, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:06:31,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f0b8a1c to 127.0.0.1:58893 2023-07-23 23:06:31,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:06:31,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 23:06:31,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 23:06:31,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 23:06:31,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 23:06:31,335 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 23:06:31,336 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690154191336 2023-07-23 23:06:31,336 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-23 23:06:31,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 23:06:31,337 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 23:06:31,337 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 23:06:31,338 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-23 23:06:31,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 23:06:31,340 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-23 23:06:31,340 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 23:06:31,341 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690154191341 2023-07-23 23:06:31,358 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-23 23:06:31,358 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-23 23:06:31,358 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:06:31,359 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-23 23:06:31,360 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-23 23:06:31,360 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,360 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,361 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:31,361 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:31,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:31,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:31,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:31,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:31,361 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:31,361 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:31,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:31,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,362 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,362 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,362 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,363 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,363 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 23:06:31,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-23 23:06:31,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,363 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 23:06:31,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-23 23:06:31,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-23 23:06:31,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,363 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-23 23:06:31,363 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 23:06:31,363 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 23:06:31,363 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:06:31,363 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-23 23:06:31,365 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 23:06:31,365 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-23 23:06:31,365 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-23 23:06:31,365 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-23 23:06:31,365 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1690153558819' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-23 23:06:31,365 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 23:06:31,365 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:06:31,365 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-23 23:06:31,366 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 23:06:31,366 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:06:31,366 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-23 23:06:31,367 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-23 23:06:31,367 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-23 23:06:31,367 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39259,1690153558742' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-23 23:06:31,367 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34863,1690153558866' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-23 23:06:31,368 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,368 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:31,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:31,369 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,369 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,369 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,369 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,369 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:06:31,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:31,369 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,370 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:06:31,370 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,370 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:06:31,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:31,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 23:06:31,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:31,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:31,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1690153558819' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-23 23:06:31,372 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29dada7d[Count = 1] remaining members to acquire global barrier 2023-07-23 23:06:31,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:31,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:31,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:31,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:31,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 23:06:31,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:31,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:31,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34863,1690153558866' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-23 23:06:31,374 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29dada7d[Count = 0] remaining members to acquire global barrier 2023-07-23 23:06:31,374 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 23:06:31,374 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,376 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,376 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,376 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,377 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 23:06:31,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,377 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 23:06:31,377 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,377 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230. 2023-07-23 23:06:31,377 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 23:06:31,377 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 23:06:31,377 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 23:06:31,377 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 23:06:31,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,377 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6. 2023-07-23 23:06:31,377 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230. started... 2023-07-23 23:06:31,377 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6. started... 2023-07-23 23:06:31,377 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,378 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 23:06:31,377 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-23 23:06:31,378 INFO [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b57266165cb03c80f3017a7b3dabeca6 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-23 23:06:31,378 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-23 23:06:31,378 INFO [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HRegion(2745): Flushing af255a9d31b2fb3634ddcfa474f60230 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-23 23:06:31,378 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39259,1690153558742' in zk 2023-07-23 23:06:31,380 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 23:06:31,380 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:06:31,380 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-23 23:06:31,423 INFO [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307234f6cb2c28df44bca81d8847e31fc84ae to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307234f6cb2c28df44bca81d8847e31fc84ae 2023-07-23 23:06:31,429 INFO [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230723ec64965c335644d7b10c43ade47dab83 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230723ec64965c335644d7b10c43ade47dab83 2023-07-23 23:06:31,437 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:06:31,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 23:06:31,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 23:06:31,439 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 23:06:31,465 INFO [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemState/b57266165cb03c80f3017a7b3dabeca6/.tmp/cf/47e960faa67f46acaa0642c5971179e3 2023-07-23 23:06:31,468 INFO [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemState/af255a9d31b2fb3634ddcfa474f60230/.tmp/cf/c352ffec41204e21a11d540e8947bdc9 2023-07-23 23:06:31,473 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemState/b57266165cb03c80f3017a7b3dabeca6/.tmp/cf/47e960faa67f46acaa0642c5971179e3 as hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemState/b57266165cb03c80f3017a7b3dabeca6/cf/47e960faa67f46acaa0642c5971179e3 2023-07-23 23:06:31,475 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemState/af255a9d31b2fb3634ddcfa474f60230/.tmp/cf/c352ffec41204e21a11d540e8947bdc9 as hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemState/af255a9d31b2fb3634ddcfa474f60230/cf/c352ffec41204e21a11d540e8947bdc9 2023-07-23 23:06:31,481 INFO [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemState/b57266165cb03c80f3017a7b3dabeca6/cf/47e960faa67f46acaa0642c5971179e3, entries=4, sequenceid=6, filesize=5.6 K 2023-07-23 23:06:31,482 INFO [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemState/af255a9d31b2fb3634ddcfa474f60230/cf/c352ffec41204e21a11d540e8947bdc9, entries=46, sequenceid=6, filesize=12.7 K 2023-07-23 23:06:31,482 INFO [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for b57266165cb03c80f3017a7b3dabeca6 in 104ms, sequenceid=6, compaction requested=false 2023-07-23 23:06:31,484 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b57266165cb03c80f3017a7b3dabeca6: 2023-07-23 23:06:31,484 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-23 23:06:31,484 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 23:06:31,484 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemState/b57266165cb03c80f3017a7b3dabeca6/cf/47e960faa67f46acaa0642c5971179e3] hfiles 2023-07-23 23:06:31,484 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemState/b57266165cb03c80f3017a7b3dabeca6/cf/47e960faa67f46acaa0642c5971179e3 for snapshot=snaptb0-testExportFileSystemState 2023-07-23 23:06:31,485 INFO [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for af255a9d31b2fb3634ddcfa474f60230 in 106ms, sequenceid=6, compaction requested=false 2023-07-23 23:06:31,485 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for af255a9d31b2fb3634ddcfa474f60230: 2023-07-23 23:06:31,485 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-23 23:06:31,485 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 23:06:31,485 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemState/af255a9d31b2fb3634ddcfa474f60230/cf/c352ffec41204e21a11d540e8947bdc9] hfiles 2023-07-23 23:06:31,485 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemState/af255a9d31b2fb3634ddcfa474f60230/cf/c352ffec41204e21a11d540e8947bdc9 for snapshot=snaptb0-testExportFileSystemState 2023-07-23 23:06:31,507 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230. completed. 2023-07-23 23:06:31,507 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6. completed. 2023-07-23 23:06:31,507 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230. 2023-07-23 23:06:31,507 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6. 2023-07-23 23:06:31,507 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 23:06:31,507 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 23:06:31,507 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 23:06:31,507 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 23:06:31,507 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,507 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,507 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-23 23:06:31,508 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-23 23:06:31,508 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38881,1690153558819' in zk 2023-07-23 23:06:31,508 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34863,1690153558866' in zk 2023-07-23 23:06:31,512 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 23:06:31,513 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,513 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:06:31,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,512 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-23 23:06:31,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:31,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:31,513 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-23 23:06:31,513 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,514 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:06:31,515 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-23 23:06:31,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:31,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:31,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 23:06:31,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:31,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:31,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 23:06:31,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:31,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,34863,1690153558866': 2023-07-23 23:06:31,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34863,1690153558866' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 23:06:31,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:31,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:31,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:31,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:31,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 23:06:31,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:31,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:31,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 23:06:31,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:31,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,38881,1690153558819': 2023-07-23 23:06:31,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1690153558819' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 23:06:31,534 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-23 23:06:31,534 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 23:06:31,534 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 23:06:31,534 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-23 23:06:31,534 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 23:06:31,536 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,536 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,537 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:31,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:31,537 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,536 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:31,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,537 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:31,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:31,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:31,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,537 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:31,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:31,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:31,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:31,538 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 23:06:31,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:31,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:31,539 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:31,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:31,539 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 23:06:31,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:31,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:31,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-23 23:06:31,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:31,542 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:31,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,542 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,543 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,547 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:31,547 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:31,547 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:31,547 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:31,547 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:06:31,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:31,547 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,547 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:31,547 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:31,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:31,549 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:31,549 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:31,547 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-23 23:06:31,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:31,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:31,549 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-23 23:06:31,549 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,549 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-23 23:06:31,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:31,550 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 23:06:31,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:31,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:31,549 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,550 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:31,550 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,550 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:31,550 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:31,550 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:31,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:31,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:31,550 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:31,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307234f6cb2c28df44bca81d8847e31fc84ae, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230723ec64965c335644d7b10c43ade47dab83] mob files 2023-07-23 23:06:31,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307234f6cb2c28df44bca81d8847e31fc84ae 2023-07-23 23:06:31,551 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230723ec64965c335644d7b10c43ade47dab83 2023-07-23 23:06:31,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-23 23:06:31,571 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,595 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,624 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-23 23:06:31,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,624 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,624 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690153591336Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1690153591570 (+234 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1690153591570Loading Region manifests for snaptb0-testExportFileSystemState at 1690153591570Writing data manifest for snaptb0-testExportFileSystemState at 1690153591575 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1690153591588 (+13 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690153591624 (+36 ms) 2023-07-23 23:06:31,627 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-23 23:06:31,629 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 290 msec 2023-07-23 23:06:31,640 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:06:31,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 23:06:31,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 23:06:31,641 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153591641 2023-07-23 23:06:31,641 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40459, tgtDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153591641, rawTgtDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153591641, srcFsUri=hdfs://localhost:40459, srcDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f 2023-07-23 23:06:31,666 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40459, inputRoot=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f 2023-07-23 23:06:31,666 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1837518530_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153591641, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153591641/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,666 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40459, inputRoot=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f, snapshotDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-23 23:06:31,678 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153591641/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-23 23:06:31,708 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:31,709 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:31,709 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:31,709 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:32,731 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/hadoop-5313227267134171433.jar 2023-07-23 23:06:32,732 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:32,733 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:32,803 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/hadoop-5529270975918253837.jar 2023-07-23 23:06:32,804 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:32,804 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:32,805 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:32,805 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:32,806 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:32,806 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:32,807 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 23:06:32,807 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 23:06:32,807 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 23:06:32,808 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 23:06:32,808 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 23:06:32,809 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 23:06:32,809 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 23:06:32,809 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 23:06:32,810 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 23:06:32,811 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 23:06:32,811 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:06:32,812 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:06:32,812 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 23:06:32,813 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:06:32,813 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:06:32,813 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 23:06:32,814 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 23:06:33,312 WARN [Listener at jenkins-hbase4.apache.org/42491] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 23:06:33,315 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-23 23:06:33,317 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-23 23:06:34,050 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 23:06:34,050 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 23:06:34,058 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0001_000001 (auth:SIMPLE) 2023-07-23 23:06:34,180 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0002_000001 (auth:SIMPLE) 2023-07-23 23:06:35,543 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 23:06:38,656 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0002_000001 (auth:SIMPLE) 2023-07-23 23:06:40,899 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0002_000001 (auth:SIMPLE) 2023-07-23 23:06:44,278 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0002_000001 (auth:SIMPLE) 2023-07-23 23:06:45,544 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 23:06:45,547 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 23:06:45,560 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-23 23:06:45,560 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 23:06:45,560 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 23:06:45,560 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2080736097_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-23 23:06:45,561 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-23 23:06:45,561 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-23 23:06:45,561 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2080736097_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153591641/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153591641/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-23 23:06:45,562 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153591641/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-23 23:06:45,562 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153591641/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-23 23:06:45,574 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-23 23:06:45,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-23 23:06:45,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-23 23:06:45,580 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153605580"}]},"ts":"1690153605580"} 2023-07-23 23:06:45,582 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-23 23:06:45,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-23 23:06:45,584 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-23 23:06:45,585 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b57266165cb03c80f3017a7b3dabeca6, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=af255a9d31b2fb3634ddcfa474f60230, UNASSIGN}] 2023-07-23 23:06:45,588 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=af255a9d31b2fb3634ddcfa474f60230, UNASSIGN 2023-07-23 23:06:45,588 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b57266165cb03c80f3017a7b3dabeca6, UNASSIGN 2023-07-23 23:06:45,589 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=af255a9d31b2fb3634ddcfa474f60230, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:45,589 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=b57266165cb03c80f3017a7b3dabeca6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:45,589 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690153605589"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153605589"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153605589"}]},"ts":"1690153605589"} 2023-07-23 23:06:45,589 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690153605589"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153605589"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153605589"}]},"ts":"1690153605589"} 2023-07-23 23:06:45,591 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure b57266165cb03c80f3017a7b3dabeca6, server=jenkins-hbase4.apache.org,38881,1690153558819}] 2023-07-23 23:06:45,592 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure af255a9d31b2fb3634ddcfa474f60230, server=jenkins-hbase4.apache.org,34863,1690153558866}] 2023-07-23 23:06:45,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-23 23:06:45,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b57266165cb03c80f3017a7b3dabeca6 2023-07-23 23:06:45,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b57266165cb03c80f3017a7b3dabeca6, disabling compactions & flushes 2023-07-23 23:06:45,746 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6. 2023-07-23 23:06:45,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6. 2023-07-23 23:06:45,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6. after waiting 0 ms 2023-07-23 23:06:45,746 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6. 2023-07-23 23:06:45,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close af255a9d31b2fb3634ddcfa474f60230 2023-07-23 23:06:45,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing af255a9d31b2fb3634ddcfa474f60230, disabling compactions & flushes 2023-07-23 23:06:45,752 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230. 2023-07-23 23:06:45,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230. 2023-07-23 23:06:45,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230. after waiting 0 ms 2023-07-23 23:06:45,752 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230. 2023-07-23 23:06:45,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemState/b57266165cb03c80f3017a7b3dabeca6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 23:06:45,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:06:45,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6. 2023-07-23 23:06:45,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b57266165cb03c80f3017a7b3dabeca6: 2023-07-23 23:06:45,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemState/af255a9d31b2fb3634ddcfa474f60230/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 23:06:45,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b57266165cb03c80f3017a7b3dabeca6 2023-07-23 23:06:45,790 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:06:45,791 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230. 2023-07-23 23:06:45,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for af255a9d31b2fb3634ddcfa474f60230: 2023-07-23 23:06:45,791 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=b57266165cb03c80f3017a7b3dabeca6, regionState=CLOSED 2023-07-23 23:06:45,792 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690153605791"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153605791"}]},"ts":"1690153605791"} 2023-07-23 23:06:45,794 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed af255a9d31b2fb3634ddcfa474f60230 2023-07-23 23:06:45,795 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=af255a9d31b2fb3634ddcfa474f60230, regionState=CLOSED 2023-07-23 23:06:45,795 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690153605795"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153605795"}]},"ts":"1690153605795"} 2023-07-23 23:06:45,797 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-23 23:06:45,797 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure b57266165cb03c80f3017a7b3dabeca6, server=jenkins-hbase4.apache.org,38881,1690153558819 in 203 msec 2023-07-23 23:06:45,800 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=b57266165cb03c80f3017a7b3dabeca6, UNASSIGN in 212 msec 2023-07-23 23:06:45,802 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-23 23:06:45,802 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure af255a9d31b2fb3634ddcfa474f60230, server=jenkins-hbase4.apache.org,34863,1690153558866 in 205 msec 2023-07-23 23:06:45,809 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-23 23:06:45,809 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=af255a9d31b2fb3634ddcfa474f60230, UNASSIGN in 217 msec 2023-07-23 23:06:45,811 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153605811"}]},"ts":"1690153605811"} 2023-07-23 23:06:45,813 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-23 23:06:45,815 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-23 23:06:45,824 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 248 msec 2023-07-23 23:06:45,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-23 23:06:45,886 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-23 23:06:45,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-23 23:06:45,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 23:06:45,892 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 23:06:45,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-23 23:06:45,894 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 23:06:45,898 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34863] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-23 23:06:45,902 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemState/b57266165cb03c80f3017a7b3dabeca6 2023-07-23 23:06:45,902 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 23:06:45,902 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 23:06:45,902 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 23:06:45,902 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 23:06:45,903 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-23 23:06:45,903 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-23 23:06:45,903 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-23 23:06:45,903 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-23 23:06:45,905 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 23:06:45,905 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 23:06:45,905 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:06:45,905 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 23:06:45,905 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-23 23:06:45,905 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:06:45,905 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:06:45,905 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:06:45,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-23 23:06:45,914 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemState/af255a9d31b2fb3634ddcfa474f60230 2023-07-23 23:06:45,917 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemState/b57266165cb03c80f3017a7b3dabeca6/cf, FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemState/b57266165cb03c80f3017a7b3dabeca6/recovered.edits] 2023-07-23 23:06:45,918 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemState/af255a9d31b2fb3634ddcfa474f60230/cf, FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemState/af255a9d31b2fb3634ddcfa474f60230/recovered.edits] 2023-07-23 23:06:45,923 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemState/b57266165cb03c80f3017a7b3dabeca6/cf/47e960faa67f46acaa0642c5971179e3 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportFileSystemState/b57266165cb03c80f3017a7b3dabeca6/cf/47e960faa67f46acaa0642c5971179e3 2023-07-23 23:06:45,924 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemState/af255a9d31b2fb3634ddcfa474f60230/cf/c352ffec41204e21a11d540e8947bdc9 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportFileSystemState/af255a9d31b2fb3634ddcfa474f60230/cf/c352ffec41204e21a11d540e8947bdc9 2023-07-23 23:06:45,927 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemState/b57266165cb03c80f3017a7b3dabeca6/recovered.edits/9.seqid to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportFileSystemState/b57266165cb03c80f3017a7b3dabeca6/recovered.edits/9.seqid 2023-07-23 23:06:45,927 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemState/af255a9d31b2fb3634ddcfa474f60230/recovered.edits/9.seqid to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportFileSystemState/af255a9d31b2fb3634ddcfa474f60230/recovered.edits/9.seqid 2023-07-23 23:06:45,928 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemState/b57266165cb03c80f3017a7b3dabeca6 2023-07-23 23:06:45,928 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemState/af255a9d31b2fb3634ddcfa474f60230 2023-07-23 23:06:45,928 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-23 23:06:45,929 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-23 23:06:45,930 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-23 23:06:45,934 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307234f6cb2c28df44bca81d8847e31fc84ae to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307234f6cb2c28df44bca81d8847e31fc84ae 2023-07-23 23:06:45,935 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230723ec64965c335644d7b10c43ade47dab83 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230723ec64965c335644d7b10c43ade47dab83 2023-07-23 23:06:45,936 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-23 23:06:45,939 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 23:06:45,942 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-23 23:06:45,946 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-23 23:06:45,947 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 23:06:45,947 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-23 23:06:45,948 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690153605948"}]},"ts":"9223372036854775807"} 2023-07-23 23:06:45,948 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690153605948"}]},"ts":"9223372036854775807"} 2023-07-23 23:06:45,955 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 23:06:45,956 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b57266165cb03c80f3017a7b3dabeca6, NAME => 'testtb-testExportFileSystemState,,1690153590302.b57266165cb03c80f3017a7b3dabeca6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => af255a9d31b2fb3634ddcfa474f60230, NAME => 'testtb-testExportFileSystemState,1,1690153590302.af255a9d31b2fb3634ddcfa474f60230.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 23:06:45,956 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-23 23:06:45,956 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690153605956"}]},"ts":"9223372036854775807"} 2023-07-23 23:06:45,959 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-23 23:06:45,963 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-23 23:06:45,965 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 75 msec 2023-07-23 23:06:46,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-23 23:06:46,014 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-23 23:06:46,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-23 23:06:46,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-23 23:06:46,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-23 23:06:46,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-23 23:06:46,059 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=760 (was 751) Potentially hanging thread: Thread-2027 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-564138229_1 at /127.0.0.1:43700 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2080736097_17 at /127.0.0.1:34380 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5c344f42-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5c344f42-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:33137 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5c344f42-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:39387 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5c344f42-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:42491 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1837518530_17 at /127.0.0.1:43728 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2080736097_17 at /127.0.0.1:60188 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=932 (was 918) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=279 (was 258) - SystemLoadAverage LEAK? -, ProcessCount=178 (was 178), AvailableMemoryMB=5921 (was 5919) - AvailableMemoryMB LEAK? - 2023-07-23 23:06:46,059 WARN [Listener at jenkins-hbase4.apache.org/42491] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-23 23:06:46,081 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=759, OpenFileDescriptor=930, MaxFileDescriptor=60000, SystemLoadAverage=279, ProcessCount=178, AvailableMemoryMB=5921 2023-07-23 23:06:46,081 WARN [Listener at jenkins-hbase4.apache.org/42491] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-23 23:06:46,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-23 23:06:46,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-23 23:06:46,086 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 23:06:46,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-23 23:06:46,087 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 23:06:46,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 23:06:46,090 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testConsecutiveExports/7ecff84d910faeac987e9496c6a938c9 2023-07-23 23:06:46,091 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testConsecutiveExports/d48b15b3688ee53d3f490ea74582b50c 2023-07-23 23:06:46,091 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testConsecutiveExports/7ecff84d910faeac987e9496c6a938c9 empty. 2023-07-23 23:06:46,091 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testConsecutiveExports/d48b15b3688ee53d3f490ea74582b50c empty. 2023-07-23 23:06:46,091 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testConsecutiveExports/7ecff84d910faeac987e9496c6a938c9 2023-07-23 23:06:46,092 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testConsecutiveExports/d48b15b3688ee53d3f490ea74582b50c 2023-07-23 23:06:46,092 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-23 23:06:46,105 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-23 23:06:46,106 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => d48b15b3688ee53d3f490ea74582b50c, NAME => 'testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp 2023-07-23 23:06:46,106 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7ecff84d910faeac987e9496c6a938c9, NAME => 'testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp 2023-07-23 23:06:46,130 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:06:46,130 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 7ecff84d910faeac987e9496c6a938c9, disabling compactions & flushes 2023-07-23 23:06:46,130 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9. 2023-07-23 23:06:46,130 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9. 2023-07-23 23:06:46,130 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9. after waiting 0 ms 2023-07-23 23:06:46,130 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9. 2023-07-23 23:06:46,130 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9. 2023-07-23 23:06:46,130 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 7ecff84d910faeac987e9496c6a938c9: 2023-07-23 23:06:46,130 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:06:46,130 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing d48b15b3688ee53d3f490ea74582b50c, disabling compactions & flushes 2023-07-23 23:06:46,130 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c. 2023-07-23 23:06:46,130 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c. 2023-07-23 23:06:46,130 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c. after waiting 0 ms 2023-07-23 23:06:46,130 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c. 2023-07-23 23:06:46,130 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c. 2023-07-23 23:06:46,130 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for d48b15b3688ee53d3f490ea74582b50c: 2023-07-23 23:06:46,133 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 23:06:46,134 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690153606134"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153606134"}]},"ts":"1690153606134"} 2023-07-23 23:06:46,135 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690153606134"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153606134"}]},"ts":"1690153606134"} 2023-07-23 23:06:46,137 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 23:06:46,138 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 23:06:46,139 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153606138"}]},"ts":"1690153606138"} 2023-07-23 23:06:46,140 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-23 23:06:46,143 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 23:06:46,144 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 23:06:46,144 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 23:06:46,144 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 23:06:46,144 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 23:06:46,144 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7ecff84d910faeac987e9496c6a938c9, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d48b15b3688ee53d3f490ea74582b50c, ASSIGN}] 2023-07-23 23:06:46,147 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d48b15b3688ee53d3f490ea74582b50c, ASSIGN 2023-07-23 23:06:46,147 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7ecff84d910faeac987e9496c6a938c9, ASSIGN 2023-07-23 23:06:46,148 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d48b15b3688ee53d3f490ea74582b50c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34863,1690153558866; forceNewPlan=false, retain=false 2023-07-23 23:06:46,148 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7ecff84d910faeac987e9496c6a938c9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39259,1690153558742; forceNewPlan=false, retain=false 2023-07-23 23:06:46,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 23:06:46,298 INFO [jenkins-hbase4:43049] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 23:06:46,301 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7ecff84d910faeac987e9496c6a938c9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:46,301 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=d48b15b3688ee53d3f490ea74582b50c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:46,302 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690153606301"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153606301"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153606301"}]},"ts":"1690153606301"} 2023-07-23 23:06:46,302 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690153606301"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153606301"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153606301"}]},"ts":"1690153606301"} 2023-07-23 23:06:46,303 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 7ecff84d910faeac987e9496c6a938c9, server=jenkins-hbase4.apache.org,39259,1690153558742}] 2023-07-23 23:06:46,304 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure d48b15b3688ee53d3f490ea74582b50c, server=jenkins-hbase4.apache.org,34863,1690153558866}] 2023-07-23 23:06:46,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 23:06:46,457 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:46,457 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 23:06:46,462 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38526, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 23:06:46,463 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c. 2023-07-23 23:06:46,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d48b15b3688ee53d3f490ea74582b50c, NAME => 'testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 23:06:46,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c. service=AccessControlService 2023-07-23 23:06:46,464 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 23:06:46,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports d48b15b3688ee53d3f490ea74582b50c 2023-07-23 23:06:46,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:06:46,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d48b15b3688ee53d3f490ea74582b50c 2023-07-23 23:06:46,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d48b15b3688ee53d3f490ea74582b50c 2023-07-23 23:06:46,467 INFO [StoreOpener-d48b15b3688ee53d3f490ea74582b50c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d48b15b3688ee53d3f490ea74582b50c 2023-07-23 23:06:46,468 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9. 2023-07-23 23:06:46,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7ecff84d910faeac987e9496c6a938c9, NAME => 'testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 23:06:46,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9. service=AccessControlService 2023-07-23 23:06:46,468 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 23:06:46,468 DEBUG [StoreOpener-d48b15b3688ee53d3f490ea74582b50c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testConsecutiveExports/d48b15b3688ee53d3f490ea74582b50c/cf 2023-07-23 23:06:46,468 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 7ecff84d910faeac987e9496c6a938c9 2023-07-23 23:06:46,468 DEBUG [StoreOpener-d48b15b3688ee53d3f490ea74582b50c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testConsecutiveExports/d48b15b3688ee53d3f490ea74582b50c/cf 2023-07-23 23:06:46,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:06:46,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7ecff84d910faeac987e9496c6a938c9 2023-07-23 23:06:46,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7ecff84d910faeac987e9496c6a938c9 2023-07-23 23:06:46,469 INFO [StoreOpener-d48b15b3688ee53d3f490ea74582b50c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d48b15b3688ee53d3f490ea74582b50c columnFamilyName cf 2023-07-23 23:06:46,470 INFO [StoreOpener-7ecff84d910faeac987e9496c6a938c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7ecff84d910faeac987e9496c6a938c9 2023-07-23 23:06:46,471 INFO [StoreOpener-d48b15b3688ee53d3f490ea74582b50c-1] regionserver.HStore(310): Store=d48b15b3688ee53d3f490ea74582b50c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 23:06:46,471 DEBUG [StoreOpener-7ecff84d910faeac987e9496c6a938c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testConsecutiveExports/7ecff84d910faeac987e9496c6a938c9/cf 2023-07-23 23:06:46,471 DEBUG [StoreOpener-7ecff84d910faeac987e9496c6a938c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testConsecutiveExports/7ecff84d910faeac987e9496c6a938c9/cf 2023-07-23 23:06:46,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testConsecutiveExports/d48b15b3688ee53d3f490ea74582b50c 2023-07-23 23:06:46,472 INFO [StoreOpener-7ecff84d910faeac987e9496c6a938c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ecff84d910faeac987e9496c6a938c9 columnFamilyName cf 2023-07-23 23:06:46,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testConsecutiveExports/d48b15b3688ee53d3f490ea74582b50c 2023-07-23 23:06:46,473 INFO [StoreOpener-7ecff84d910faeac987e9496c6a938c9-1] regionserver.HStore(310): Store=7ecff84d910faeac987e9496c6a938c9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 23:06:46,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testConsecutiveExports/7ecff84d910faeac987e9496c6a938c9 2023-07-23 23:06:46,474 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testConsecutiveExports/7ecff84d910faeac987e9496c6a938c9 2023-07-23 23:06:46,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d48b15b3688ee53d3f490ea74582b50c 2023-07-23 23:06:46,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testConsecutiveExports/d48b15b3688ee53d3f490ea74582b50c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 23:06:46,477 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d48b15b3688ee53d3f490ea74582b50c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58808985, jitterRate=-0.12367783486843109}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 23:06:46,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d48b15b3688ee53d3f490ea74582b50c: 2023-07-23 23:06:46,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7ecff84d910faeac987e9496c6a938c9 2023-07-23 23:06:46,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c., pid=46, masterSystemTime=1690153606457 2023-07-23 23:06:46,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c. 2023-07-23 23:06:46,481 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c. 2023-07-23 23:06:46,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testConsecutiveExports/7ecff84d910faeac987e9496c6a938c9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 23:06:46,481 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7ecff84d910faeac987e9496c6a938c9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73333786, jitterRate=0.09275856614112854}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 23:06:46,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7ecff84d910faeac987e9496c6a938c9: 2023-07-23 23:06:46,481 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=d48b15b3688ee53d3f490ea74582b50c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:46,482 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690153606481"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690153606481"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690153606481"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690153606481"}]},"ts":"1690153606481"} 2023-07-23 23:06:46,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9., pid=45, masterSystemTime=1690153606457 2023-07-23 23:06:46,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9. 2023-07-23 23:06:46,488 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9. 2023-07-23 23:06:46,488 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=7ecff84d910faeac987e9496c6a938c9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:46,488 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690153606488"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690153606488"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690153606488"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690153606488"}]},"ts":"1690153606488"} 2023-07-23 23:06:46,490 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-23 23:06:46,490 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure d48b15b3688ee53d3f490ea74582b50c, server=jenkins-hbase4.apache.org,34863,1690153558866 in 183 msec 2023-07-23 23:06:46,491 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d48b15b3688ee53d3f490ea74582b50c, ASSIGN in 346 msec 2023-07-23 23:06:46,492 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-23 23:06:46,492 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 7ecff84d910faeac987e9496c6a938c9, server=jenkins-hbase4.apache.org,39259,1690153558742 in 187 msec 2023-07-23 23:06:46,494 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-23 23:06:46,494 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7ecff84d910faeac987e9496c6a938c9, ASSIGN in 348 msec 2023-07-23 23:06:46,495 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 23:06:46,495 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153606495"}]},"ts":"1690153606495"} 2023-07-23 23:06:46,497 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-23 23:06:46,500 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 23:06:46,501 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-23 23:06:46,502 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34863] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-23 23:06:46,504 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:06:46,504 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:06:46,504 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:06:46,504 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:06:46,505 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 23:06:46,505 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 23:06:46,505 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 23:06:46,505 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-23 23:06:46,507 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 422 msec 2023-07-23 23:06:46,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-23 23:06:46,691 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-23 23:06:46,694 DEBUG [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-23 23:06:46,694 DEBUG [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9. 2023-07-23 23:06:46,698 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 23:06:46,706 DEBUG [hconnection-0x41a54ec6-shared-pool-16] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:06:46,712 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38532, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:06:46,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 23:06:46,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690153606718 (current time:1690153606718). 2023-07-23 23:06:46,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 23:06:46,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(139): Connect 0x00b5451f to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:06:46,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f62d7cb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:06:46,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:06:46,731 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39376, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:06:46,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x00b5451f to 127.0.0.1:58893 2023-07-23 23:06:46,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:06:46,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(139): Connect 0x3d39b399 to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:06:46,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@178e849c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:06:46,748 DEBUG [hconnection-0x6eabc529-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:06:46,750 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:06:46,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:06:46,757 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:06:46,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3d39b399 to 127.0.0.1:58893 2023-07-23 23:06:46,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:06:46,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-23 23:06:46,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 23:06:46,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 23:06:46,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 23:06:46,763 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 23:06:46,764 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690154206764 2023-07-23 23:06:46,764 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-23 23:06:46,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 23:06:46,766 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 23:06:46,766 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 23:06:46,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 23:06:46,768 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 23:06:46,769 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-23 23:06:46,770 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 23:06:46,771 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690154206771 2023-07-23 23:06:46,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,787 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-23 23:06:46,787 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:06:46,788 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-23 23:06:46,788 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-23 23:06:46,789 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,789 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,790 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:46,790 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:46,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:46,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:46,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:46,790 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:46,790 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:46,790 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:46,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:46,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:46,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,790 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:46,791 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:46,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,791 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:46,791 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 23:06:46,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-23 23:06:46,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-23 23:06:46,792 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 23:06:46,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,792 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 23:06:46,792 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,792 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 23:06:46,792 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:06:46,793 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 23:06:46,794 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,794 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-23 23:06:46,794 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 23:06:46,794 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39259,1690153558742' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-23 23:06:46,794 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:06:46,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-23 23:06:46,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,795 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 23:06:46,795 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-23 23:06:46,795 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34863,1690153558866' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-23 23:06:46,795 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 23:06:46,795 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,795 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 23:06:46,795 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:06:46,798 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 23:06:46,798 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-23 23:06:46,798 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1690153558819' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-23 23:06:46,802 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:46,802 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:46,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:46,802 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,802 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:46,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:46,803 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,803 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:46,803 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,804 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:06:46,803 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:06:46,804 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,804 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:06:46,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:46,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:46,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:46,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:46,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:46,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34863,1690153558866' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-23 23:06:46,807 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28a08368[Count = 1] remaining members to acquire global barrier 2023-07-23 23:06:46,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:46,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:46,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:46,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:46,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:46,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:46,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:46,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:46,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:46,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39259,1690153558742' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-23 23:06:46,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28a08368[Count = 0] remaining members to acquire global barrier 2023-07-23 23:06:46,809 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-23 23:06:46,809 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,810 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,810 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,811 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,811 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 23:06:46,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,811 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 23:06:46,811 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 23:06:46,811 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:46,811 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9. 2023-07-23 23:06:46,811 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 23:06:46,811 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-23 23:06:46,811 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9. started... 2023-07-23 23:06:46,811 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 23:06:46,811 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38881,1690153558819' in zk 2023-07-23 23:06:46,811 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:46,811 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 23:06:46,811 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 23:06:46,812 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 23:06:46,812 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c. 2023-07-23 23:06:46,812 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c. started... 2023-07-23 23:06:46,812 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7ecff84d910faeac987e9496c6a938c9: 2023-07-23 23:06:46,813 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d48b15b3688ee53d3f490ea74582b50c: 2023-07-23 23:06:46,813 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,813 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 23:06:46,813 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,813 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 23:06:46,813 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 23:06:46,813 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 23:06:46,818 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 23:06:46,819 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:06:46,819 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-23 23:06:46,831 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c. completed. 2023-07-23 23:06:46,831 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c. 2023-07-23 23:06:46,831 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 23:06:46,831 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 23:06:46,831 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:46,831 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-23 23:06:46,831 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34863,1690153558866' in zk 2023-07-23 23:06:46,833 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 23:06:46,833 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:06:46,833 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-23 23:06:46,834 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:46,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:46,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:46,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:46,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:46,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:46,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:46,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:46,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:46,838 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9. completed. 2023-07-23 23:06:46,838 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9. 2023-07-23 23:06:46,838 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 23:06:46,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:46,838 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 23:06:46,838 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:46,838 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-23 23:06:46,838 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39259,1690153558742' in zk 2023-07-23 23:06:46,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:46,840 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:46,840 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 23:06:46,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:46,840 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:06:46,840 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-23 23:06:46,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34863,1690153558866': 2023-07-23 23:06:46,841 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34863,1690153558866' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-23 23:06:46,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:46,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:46,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:46,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:46,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:46,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:46,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:46,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:46,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:46,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:46,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:46,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:46,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39259,1690153558742': 2023-07-23 23:06:46,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39259,1690153558742' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-23 23:06:46,845 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-23 23:06:46,845 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 23:06:46,845 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 23:06:46,845 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,845 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 23:06:46,847 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,847 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,847 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,847 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,847 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:46,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,847 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:46,847 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:46,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:46,848 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:46,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:46,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:46,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,847 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:46,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,848 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:46,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:46,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:46,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:46,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:46,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:46,849 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:46,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:46,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:46,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:46,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:46,851 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:46,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:46,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,852 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:46,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:46,852 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:46,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:46,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:46,856 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:46,856 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:46,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:46,856 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:46,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:46,857 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:06:46,857 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:46,857 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,857 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:46,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:46,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:46,856 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:46,856 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:46,857 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:46,857 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,857 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:46,857 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,857 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:46,857 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:46,857 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,857 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,857 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,859 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-23 23:06:46,859 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,859 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 23:06:46,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:46,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:46,857 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:46,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:46,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:46,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:46,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:46,860 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-23 23:06:46,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:46,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:46,866 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:06:46,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 23:06:46,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-23 23:06:46,867 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 23:06:46,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,895 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,918 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-23 23:06:46,918 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,918 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-23 23:06:46,919 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690153606764Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1690153606869 (+105 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1690153606869Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1690153606870 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1690153606875 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1690153606887 (+12 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690153606918 (+31 ms) 2023-07-23 23:06:46,923 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 23:06:46,925 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 159 msec 2023-07-23 23:06:47,067 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:06:47,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 23:06:47,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 23:06:47,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39259] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 23:06:47,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34863] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 23:06:47,076 DEBUG [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-23 23:06:47,076 DEBUG [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9. 2023-07-23 23:06:47,076 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 23:06:47,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 23:06:47,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690153607086 (current time:1690153607086). 2023-07-23 23:06:47,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 23:06:47,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(139): Connect 0x469587d1 to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:06:47,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3fcc424d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:06:47,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:06:47,102 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:06:47,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x469587d1 to 127.0.0.1:58893 2023-07-23 23:06:47,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:06:47,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(139): Connect 0x1ff2b32b to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:06:47,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@75b3140b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:06:47,122 DEBUG [hconnection-0x28b0feda-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:06:47,125 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39416, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:06:47,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:06:47,130 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53752, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:06:47,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ff2b32b to 127.0.0.1:58893 2023-07-23 23:06:47,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:06:47,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-23 23:06:47,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 23:06:47,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 23:06:47,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 23:06:47,136 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 23:06:47,137 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690154207137 2023-07-23 23:06:47,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-23 23:06:47,137 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-23 23:06:47,138 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 23:06:47,138 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 23:06:47,139 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 23:06:47,139 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-23 23:06:47,141 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-23 23:06:47,142 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 23:06:47,142 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690154207142 2023-07-23 23:06:47,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-23 23:06:47,157 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-23 23:06:47,157 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:06:47,159 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-23 23:06:47,159 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-23 23:06:47,159 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,159 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,160 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:47,160 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:47,160 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:47,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:47,161 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:47,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:47,161 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:47,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:47,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:47,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:47,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:47,161 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:47,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,162 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:47,162 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 23:06:47,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-23 23:06:47,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-23 23:06:47,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,162 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 23:06:47,162 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 23:06:47,163 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-23 23:06:47,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-23 23:06:47,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,163 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 23:06:47,163 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:06:47,163 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-23 23:06:47,163 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-23 23:06:47,163 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 23:06:47,164 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-23 23:06:47,164 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 23:06:47,164 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-23 23:06:47,164 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:06:47,165 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:06:47,164 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-23 23:06:47,166 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 23:06:47,166 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39259,1690153558742' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-23 23:06:47,166 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-23 23:06:47,166 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-23 23:06:47,166 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-23 23:06:47,167 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1690153558819' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-23 23:06:47,167 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34863,1690153558866' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-23 23:06:47,168 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,168 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:47,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:47,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:47,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:47,169 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,169 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,169 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,169 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:06:47,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:47,169 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:47,169 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,169 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:06:47,169 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,169 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:06:47,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:47,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 23:06:47,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:47,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:47,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:47,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:47,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39259,1690153558742' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-23 23:06:47,171 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@719295d2[Count = 1] remaining members to acquire global barrier 2023-07-23 23:06:47,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:47,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:47,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:47,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:47,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:47,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 23:06:47,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:47,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:47,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:47,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:47,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34863,1690153558866' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-23 23:06:47,173 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@719295d2[Count = 0] remaining members to acquire global barrier 2023-07-23 23:06:47,173 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-23 23:06:47,173 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,175 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,175 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,175 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,175 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 23:06:47,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,175 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:47,175 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,175 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 23:06:47,175 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 23:06:47,175 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c. 2023-07-23 23:06:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,175 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c. started... 2023-07-23 23:06:47,175 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:47,175 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 23:06:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,175 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 23:06:47,175 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-23 23:06:47,175 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-23 23:06:47,175 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38881,1690153558819' in zk 2023-07-23 23:06:47,176 INFO [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d48b15b3688ee53d3f490ea74582b50c 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-23 23:06:47,178 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 23:06:47,178 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:06:47,178 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-23 23:06:47,179 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 23:06:47,179 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 23:06:47,180 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9. 2023-07-23 23:06:47,180 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9. started... 2023-07-23 23:06:47,180 INFO [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7ecff84d910faeac987e9496c6a938c9 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-23 23:06:47,238 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:06:47,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 23:06:47,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-23 23:06:47,240 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 23:06:47,241 INFO [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307236debb087e95e429b96176e95085d1714 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307236debb087e95e429b96176e95085d1714 2023-07-23 23:06:47,242 INFO [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072307c25588af664ae5bb4eab09187095f7 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023072307c25588af664ae5bb4eab09187095f7 2023-07-23 23:06:47,259 INFO [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testConsecutiveExports/7ecff84d910faeac987e9496c6a938c9/.tmp/cf/c4896551a7d64a2fa1edcd5a705b21c1 2023-07-23 23:06:47,266 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testConsecutiveExports/7ecff84d910faeac987e9496c6a938c9/.tmp/cf/c4896551a7d64a2fa1edcd5a705b21c1 as hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testConsecutiveExports/7ecff84d910faeac987e9496c6a938c9/cf/c4896551a7d64a2fa1edcd5a705b21c1 2023-07-23 23:06:47,266 INFO [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testConsecutiveExports/d48b15b3688ee53d3f490ea74582b50c/.tmp/cf/094122def0cf49858a8005d5b108e081 2023-07-23 23:06:47,271 INFO [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testConsecutiveExports/7ecff84d910faeac987e9496c6a938c9/cf/c4896551a7d64a2fa1edcd5a705b21c1, entries=4, sequenceid=6, filesize=5.5 K 2023-07-23 23:06:47,272 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testConsecutiveExports/d48b15b3688ee53d3f490ea74582b50c/.tmp/cf/094122def0cf49858a8005d5b108e081 as hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testConsecutiveExports/d48b15b3688ee53d3f490ea74582b50c/cf/094122def0cf49858a8005d5b108e081 2023-07-23 23:06:47,272 INFO [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 7ecff84d910faeac987e9496c6a938c9 in 92ms, sequenceid=6, compaction requested=false 2023-07-23 23:06:47,273 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-23 23:06:47,273 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7ecff84d910faeac987e9496c6a938c9: 2023-07-23 23:06:47,273 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-23 23:06:47,273 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 23:06:47,274 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testConsecutiveExports/7ecff84d910faeac987e9496c6a938c9/cf/c4896551a7d64a2fa1edcd5a705b21c1] hfiles 2023-07-23 23:06:47,274 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testConsecutiveExports/7ecff84d910faeac987e9496c6a938c9/cf/c4896551a7d64a2fa1edcd5a705b21c1 for snapshot=snaptb0-testConsecutiveExports 2023-07-23 23:06:47,279 INFO [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testConsecutiveExports/d48b15b3688ee53d3f490ea74582b50c/cf/094122def0cf49858a8005d5b108e081, entries=46, sequenceid=6, filesize=12.5 K 2023-07-23 23:06:47,280 INFO [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for d48b15b3688ee53d3f490ea74582b50c in 105ms, sequenceid=6, compaction requested=false 2023-07-23 23:06:47,281 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d48b15b3688ee53d3f490ea74582b50c: 2023-07-23 23:06:47,282 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-23 23:06:47,282 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 23:06:47,282 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testConsecutiveExports/d48b15b3688ee53d3f490ea74582b50c/cf/094122def0cf49858a8005d5b108e081] hfiles 2023-07-23 23:06:47,282 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testConsecutiveExports/d48b15b3688ee53d3f490ea74582b50c/cf/094122def0cf49858a8005d5b108e081 for snapshot=snaptb0-testConsecutiveExports 2023-07-23 23:06:47,284 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9. completed. 2023-07-23 23:06:47,284 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9. 2023-07-23 23:06:47,284 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 23:06:47,284 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 23:06:47,284 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:47,284 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-23 23:06:47,284 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39259,1690153558742' in zk 2023-07-23 23:06:47,286 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 23:06:47,286 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:47,286 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:06:47,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:47,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:47,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:47,286 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-23 23:06:47,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:47,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:47,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 23:06:47,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:47,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:47,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:47,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:47,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 23:06:47,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:47,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:47,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39259,1690153558742': 2023-07-23 23:06:47,293 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39259,1690153558742' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-23 23:06:47,295 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c. completed. 2023-07-23 23:06:47,295 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c. 2023-07-23 23:06:47,295 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 23:06:47,295 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 23:06:47,295 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:47,295 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-23 23:06:47,295 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34863,1690153558866' in zk 2023-07-23 23:06:47,297 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:47,297 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-23 23:06:47,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:47,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:47,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:47,297 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:06:47,297 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-23 23:06:47,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:47,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:47,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 23:06:47,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:47,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:47,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:47,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:47,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 23:06:47,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:47,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:47,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:47,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34863,1690153558866': 2023-07-23 23:06:47,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34863,1690153558866' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-23 23:06:47,302 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-23 23:06:47,302 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 23:06:47,302 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 23:06:47,302 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-23 23:06:47,302 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 23:06:47,305 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,305 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,305 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,305 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:06:47,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:06:47,305 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:47,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,305 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:47,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:47,305 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:47,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:47,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,306 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:47,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:06:47,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:47,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:47,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:47,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:47,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 23:06:47,306 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:47,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:06:47,307 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:47,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 23:06:47,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:47,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:47,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:47,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:06:47,309 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:47,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-23 23:06:47,310 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:47,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:47,310 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:47,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:47,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:47,316 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:47,316 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,316 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:47,316 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:47,316 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,316 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:06:47,316 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,317 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:06:47,317 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:06:47,317 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:06:47,317 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:47,317 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,317 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:47,319 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,319 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:47,317 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-23 23:06:47,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:47,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:47,319 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:06:47,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:47,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:47,319 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:47,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:06:47,319 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:06:47,319 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-23 23:06:47,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:47,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:47,319 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:47,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:47,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:06:47,319 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-23 23:06:47,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 23:06:47,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:06:47,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:06:47,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023072307c25588af664ae5bb4eab09187095f7, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307236debb087e95e429b96176e95085d1714] mob files 2023-07-23 23:06:47,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023072307c25588af664ae5bb4eab09187095f7 2023-07-23 23:06:47,321 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307236debb087e95e429b96176e95085d1714 2023-07-23 23:06:47,337 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-23 23:06:47,338 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,363 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,412 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-23 23:06:47,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,413 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,413 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690153607137Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1690153607337 (+200 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1690153607337Loading Region manifests for snaptb0-testConsecutiveExports at 1690153607337Writing data manifest for snaptb0-testConsecutiveExports at 1690153607341 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1690153607351 (+10 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690153607412 (+61 ms) 2023-07-23 23:06:47,416 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-23 23:06:47,418 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 278 msec 2023-07-23 23:06:47,440 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:06:47,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-23 23:06:47,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 23:06:47,442 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/local-export-1690153607442 2023-07-23 23:06:47,442 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/local-export-1690153607442, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/local-export-1690153607442, srcFsUri=hdfs://localhost:40459, srcDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f 2023-07-23 23:06:47,471 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40459, inputRoot=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f 2023-07-23 23:06:47,471 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6834ba4e, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/local-export-1690153607442, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/local-export-1690153607442/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,471 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40459, inputRoot=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f, snapshotDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-23 23:06:47,483 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/local-export-1690153607442/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 23:06:47,496 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:47,497 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:47,497 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:47,498 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:48,448 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/hadoop-258266807274629420.jar 2023-07-23 23:06:48,449 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:48,450 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:48,525 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/hadoop-3692639248069046714.jar 2023-07-23 23:06:48,526 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:48,526 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:48,527 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:48,527 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:48,527 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:48,528 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 23:06:48,528 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 23:06:48,528 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 23:06:48,529 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 23:06:48,529 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 23:06:48,529 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 23:06:48,530 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 23:06:48,530 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 23:06:48,531 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 23:06:48,531 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 23:06:48,531 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 23:06:48,532 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:06:48,532 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:06:48,533 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 23:06:48,533 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:06:48,534 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:06:48,534 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 23:06:48,535 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 23:06:48,982 WARN [Listener at jenkins-hbase4.apache.org/42491] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 23:06:48,985 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-23 23:06:48,988 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-23 23:06:50,457 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 23:06:50,458 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 23:06:50,463 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0002_000001 (auth:SIMPLE) 2023-07-23 23:06:51,289 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0003_000001 (auth:SIMPLE) 2023-07-23 23:06:51,399 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 23:06:55,619 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0003_000001 (auth:SIMPLE) 2023-07-23 23:06:57,885 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0003_000001 (auth:SIMPLE) 2023-07-23 23:07:00,379 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0003_000001 (auth:SIMPLE) 2023-07-23 23:07:02,178 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 23:07:02,178 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 23:07:02,183 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-23 23:07:02,183 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 23:07:02,184 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 23:07:02,184 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2080736097_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 23:07:02,184 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 23:07:02,185 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 23:07:02,185 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@4c4bb752 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/local-export-1690153607442/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/local-export-1690153607442/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 23:07:02,185 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/local-export-1690153607442/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 23:07:02,185 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/local-export-1690153607442/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 23:07:02,186 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/local-export-1690153607442, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/local-export-1690153607442, srcFsUri=hdfs://localhost:40459, srcDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f 2023-07-23 23:07:02,214 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40459, inputRoot=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f 2023-07-23 23:07:02,214 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@54804993, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/local-export-1690153607442, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/local-export-1690153607442/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 23:07:02,214 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40459, inputRoot=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f, snapshotDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-23 23:07:02,224 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/local-export-1690153607442/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-23 23:07:02,236 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:02,236 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:02,237 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:02,237 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:03,117 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/hadoop-1623939491490318976.jar 2023-07-23 23:07:03,117 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:03,118 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:03,184 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/hadoop-3218687513866313552.jar 2023-07-23 23:07:03,185 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:03,185 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:03,185 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:03,186 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:03,186 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:03,187 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:03,187 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 23:07:03,188 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 23:07:03,188 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 23:07:03,188 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 23:07:03,189 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 23:07:03,189 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 23:07:03,189 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 23:07:03,190 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 23:07:03,190 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 23:07:03,191 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 23:07:03,191 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:07:03,192 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:07:03,192 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 23:07:03,192 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:07:03,193 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:07:03,193 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 23:07:03,194 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 23:07:03,609 WARN [Listener at jenkins-hbase4.apache.org/42491] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 23:07:03,612 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-23 23:07:03,613 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-23 23:07:06,571 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 23:07:06,571 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 23:07:06,577 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0003_000001 (auth:SIMPLE) 2023-07-23 23:07:07,479 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0004_000001 (auth:SIMPLE) 2023-07-23 23:07:12,084 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0004_000001 (auth:SIMPLE) 2023-07-23 23:07:14,354 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0004_000001 (auth:SIMPLE) 2023-07-23 23:07:17,786 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0004_000001 (auth:SIMPLE) 2023-07-23 23:07:19,824 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 23:07:19,824 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 23:07:19,830 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-23 23:07:19,830 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 23:07:19,830 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 23:07:19,830 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2080736097_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 23:07:19,833 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 23:07:19,834 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 23:07:19,834 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@4c4bb752 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/local-export-1690153607442/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/local-export-1690153607442/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-23 23:07:19,834 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/local-export-1690153607442/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-23 23:07:19,834 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/local-export-1690153607442/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-23 23:07:19,851 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-23 23:07:19,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-23 23:07:19,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-23 23:07:19,858 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153639858"}]},"ts":"1690153639858"} 2023-07-23 23:07:19,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-23 23:07:19,861 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-23 23:07:19,863 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-23 23:07:19,864 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7ecff84d910faeac987e9496c6a938c9, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d48b15b3688ee53d3f490ea74582b50c, UNASSIGN}] 2023-07-23 23:07:19,865 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d48b15b3688ee53d3f490ea74582b50c, UNASSIGN 2023-07-23 23:07:19,867 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7ecff84d910faeac987e9496c6a938c9, UNASSIGN 2023-07-23 23:07:19,867 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=d48b15b3688ee53d3f490ea74582b50c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:19,867 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690153639867"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153639867"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153639867"}]},"ts":"1690153639867"} 2023-07-23 23:07:19,869 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=7ecff84d910faeac987e9496c6a938c9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:19,869 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure d48b15b3688ee53d3f490ea74582b50c, server=jenkins-hbase4.apache.org,34863,1690153558866}] 2023-07-23 23:07:19,870 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690153639869"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153639869"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153639869"}]},"ts":"1690153639869"} 2023-07-23 23:07:19,873 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 7ecff84d910faeac987e9496c6a938c9, server=jenkins-hbase4.apache.org,39259,1690153558742}] 2023-07-23 23:07:19,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-23 23:07:20,024 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d48b15b3688ee53d3f490ea74582b50c 2023-07-23 23:07:20,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d48b15b3688ee53d3f490ea74582b50c, disabling compactions & flushes 2023-07-23 23:07:20,025 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c. 2023-07-23 23:07:20,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c. 2023-07-23 23:07:20,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c. after waiting 0 ms 2023-07-23 23:07:20,025 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c. 2023-07-23 23:07:20,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7ecff84d910faeac987e9496c6a938c9 2023-07-23 23:07:20,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7ecff84d910faeac987e9496c6a938c9, disabling compactions & flushes 2023-07-23 23:07:20,031 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9. 2023-07-23 23:07:20,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9. 2023-07-23 23:07:20,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9. after waiting 0 ms 2023-07-23 23:07:20,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9. 2023-07-23 23:07:20,067 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testConsecutiveExports/7ecff84d910faeac987e9496c6a938c9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 23:07:20,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testConsecutiveExports/d48b15b3688ee53d3f490ea74582b50c/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 23:07:20,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:07:20,071 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:07:20,071 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c. 2023-07-23 23:07:20,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d48b15b3688ee53d3f490ea74582b50c: 2023-07-23 23:07:20,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9. 2023-07-23 23:07:20,072 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7ecff84d910faeac987e9496c6a938c9: 2023-07-23 23:07:20,075 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d48b15b3688ee53d3f490ea74582b50c 2023-07-23 23:07:20,075 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=d48b15b3688ee53d3f490ea74582b50c, regionState=CLOSED 2023-07-23 23:07:20,076 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690153640075"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153640075"}]},"ts":"1690153640075"} 2023-07-23 23:07:20,076 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7ecff84d910faeac987e9496c6a938c9 2023-07-23 23:07:20,077 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=7ecff84d910faeac987e9496c6a938c9, regionState=CLOSED 2023-07-23 23:07:20,078 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690153640077"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153640077"}]},"ts":"1690153640077"} 2023-07-23 23:07:20,082 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-23 23:07:20,082 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure d48b15b3688ee53d3f490ea74582b50c, server=jenkins-hbase4.apache.org,34863,1690153558866 in 209 msec 2023-07-23 23:07:20,083 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-23 23:07:20,083 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d48b15b3688ee53d3f490ea74582b50c, UNASSIGN in 218 msec 2023-07-23 23:07:20,083 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 7ecff84d910faeac987e9496c6a938c9, server=jenkins-hbase4.apache.org,39259,1690153558742 in 208 msec 2023-07-23 23:07:20,085 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-23 23:07:20,085 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=7ecff84d910faeac987e9496c6a938c9, UNASSIGN in 219 msec 2023-07-23 23:07:20,086 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153640086"}]},"ts":"1690153640086"} 2023-07-23 23:07:20,087 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-23 23:07:20,089 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-23 23:07:20,091 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 238 msec 2023-07-23 23:07:20,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-23 23:07:20,169 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-23 23:07:20,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-23 23:07:20,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 23:07:20,176 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 23:07:20,179 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 23:07:20,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-23 23:07:20,187 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34863] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-23 23:07:20,190 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testConsecutiveExports/7ecff84d910faeac987e9496c6a938c9 2023-07-23 23:07:20,192 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 23:07:20,193 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 23:07:20,193 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 23:07:20,193 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 23:07:20,193 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-23 23:07:20,194 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-23 23:07:20,195 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-23 23:07:20,195 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-23 23:07:20,195 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 23:07:20,196 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:20,196 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 23:07:20,196 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:20,196 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 23:07:20,196 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-23 23:07:20,196 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:20,196 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:20,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-23 23:07:20,203 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testConsecutiveExports/d48b15b3688ee53d3f490ea74582b50c 2023-07-23 23:07:20,204 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testConsecutiveExports/7ecff84d910faeac987e9496c6a938c9/cf, FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testConsecutiveExports/7ecff84d910faeac987e9496c6a938c9/recovered.edits] 2023-07-23 23:07:20,205 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testConsecutiveExports/d48b15b3688ee53d3f490ea74582b50c/cf, FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testConsecutiveExports/d48b15b3688ee53d3f490ea74582b50c/recovered.edits] 2023-07-23 23:07:20,209 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testConsecutiveExports/7ecff84d910faeac987e9496c6a938c9/cf/c4896551a7d64a2fa1edcd5a705b21c1 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testConsecutiveExports/7ecff84d910faeac987e9496c6a938c9/cf/c4896551a7d64a2fa1edcd5a705b21c1 2023-07-23 23:07:20,210 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testConsecutiveExports/d48b15b3688ee53d3f490ea74582b50c/cf/094122def0cf49858a8005d5b108e081 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testConsecutiveExports/d48b15b3688ee53d3f490ea74582b50c/cf/094122def0cf49858a8005d5b108e081 2023-07-23 23:07:20,213 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testConsecutiveExports/7ecff84d910faeac987e9496c6a938c9/recovered.edits/9.seqid to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testConsecutiveExports/7ecff84d910faeac987e9496c6a938c9/recovered.edits/9.seqid 2023-07-23 23:07:20,213 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testConsecutiveExports/7ecff84d910faeac987e9496c6a938c9 2023-07-23 23:07:20,225 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testConsecutiveExports/d48b15b3688ee53d3f490ea74582b50c/recovered.edits/9.seqid to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testConsecutiveExports/d48b15b3688ee53d3f490ea74582b50c/recovered.edits/9.seqid 2023-07-23 23:07:20,226 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testConsecutiveExports/d48b15b3688ee53d3f490ea74582b50c 2023-07-23 23:07:20,226 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-23 23:07:20,228 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-23 23:07:20,229 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-23 23:07:20,234 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023072307c25588af664ae5bb4eab09187095f7 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023072307c25588af664ae5bb4eab09187095f7 2023-07-23 23:07:20,236 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307236debb087e95e429b96176e95085d1714 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307236debb087e95e429b96176e95085d1714 2023-07-23 23:07:20,237 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-23 23:07:20,240 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 23:07:20,243 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-23 23:07:20,255 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-23 23:07:20,257 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 23:07:20,257 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-23 23:07:20,257 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690153640257"}]},"ts":"9223372036854775807"} 2023-07-23 23:07:20,257 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690153640257"}]},"ts":"9223372036854775807"} 2023-07-23 23:07:20,279 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 23:07:20,279 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7ecff84d910faeac987e9496c6a938c9, NAME => 'testtb-testConsecutiveExports,,1690153606083.7ecff84d910faeac987e9496c6a938c9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => d48b15b3688ee53d3f490ea74582b50c, NAME => 'testtb-testConsecutiveExports,1,1690153606083.d48b15b3688ee53d3f490ea74582b50c.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 23:07:20,280 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-23 23:07:20,280 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690153640280"}]},"ts":"9223372036854775807"} 2023-07-23 23:07:20,285 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-23 23:07:20,287 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-23 23:07:20,288 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 117 msec 2023-07-23 23:07:20,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-23 23:07:20,299 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-23 23:07:20,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-23 23:07:20,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-23 23:07:20,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-23 23:07:20,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-23 23:07:20,355 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=747 (was 759), OpenFileDescriptor=896 (was 930), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=333 (was 279) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 178) - ProcessCount LEAK? -, AvailableMemoryMB=6176 (was 5921) - AvailableMemoryMB LEAK? - 2023-07-23 23:07:20,356 WARN [Listener at jenkins-hbase4.apache.org/42491] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-23 23:07:20,384 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=333, ProcessCount=177, AvailableMemoryMB=6196 2023-07-23 23:07:20,384 WARN [Listener at jenkins-hbase4.apache.org/42491] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-23 23:07:20,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-23 23:07:20,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:20,393 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 23:07:20,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-23 23:07:20,394 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 23:07:20,400 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e55640b856f8ffb8c42b40d8dc5afc3b 2023-07-23 23:07:20,400 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/09386da05024281c176c399194de0545 2023-07-23 23:07:20,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 23:07:20,401 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e55640b856f8ffb8c42b40d8dc5afc3b empty. 2023-07-23 23:07:20,401 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/09386da05024281c176c399194de0545 empty. 2023-07-23 23:07:20,401 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e55640b856f8ffb8c42b40d8dc5afc3b 2023-07-23 23:07:20,401 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/09386da05024281c176c399194de0545 2023-07-23 23:07:20,401 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-23 23:07:20,438 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-23 23:07:20,443 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => e55640b856f8ffb8c42b40d8dc5afc3b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp 2023-07-23 23:07:20,444 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 09386da05024281c176c399194de0545, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp 2023-07-23 23:07:20,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 23:07:20,528 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:07:20,529 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing e55640b856f8ffb8c42b40d8dc5afc3b, disabling compactions & flushes 2023-07-23 23:07:20,529 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b. 2023-07-23 23:07:20,529 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b. 2023-07-23 23:07:20,529 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b. after waiting 0 ms 2023-07-23 23:07:20,529 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b. 2023-07-23 23:07:20,529 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b. 2023-07-23 23:07:20,529 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for e55640b856f8ffb8c42b40d8dc5afc3b: 2023-07-23 23:07:20,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 23:07:20,926 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:07:20,926 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 09386da05024281c176c399194de0545, disabling compactions & flushes 2023-07-23 23:07:20,926 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545. 2023-07-23 23:07:20,926 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545. 2023-07-23 23:07:20,927 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545. after waiting 0 ms 2023-07-23 23:07:20,927 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545. 2023-07-23 23:07:20,927 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545. 2023-07-23 23:07:20,927 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 09386da05024281c176c399194de0545: 2023-07-23 23:07:20,930 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 23:07:20,931 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690153640931"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153640931"}]},"ts":"1690153640931"} 2023-07-23 23:07:20,931 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690153640931"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153640931"}]},"ts":"1690153640931"} 2023-07-23 23:07:20,940 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 23:07:20,941 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 23:07:20,941 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153640941"}]},"ts":"1690153640941"} 2023-07-23 23:07:20,943 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-23 23:07:20,945 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 23:07:20,947 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 23:07:20,947 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 23:07:20,947 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 23:07:20,947 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 23:07:20,948 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e55640b856f8ffb8c42b40d8dc5afc3b, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=09386da05024281c176c399194de0545, ASSIGN}] 2023-07-23 23:07:20,950 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=09386da05024281c176c399194de0545, ASSIGN 2023-07-23 23:07:20,950 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e55640b856f8ffb8c42b40d8dc5afc3b, ASSIGN 2023-07-23 23:07:20,955 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=09386da05024281c176c399194de0545, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1690153558819; forceNewPlan=false, retain=false 2023-07-23 23:07:20,955 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e55640b856f8ffb8c42b40d8dc5afc3b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34863,1690153558866; forceNewPlan=false, retain=false 2023-07-23 23:07:21,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 23:07:21,105 INFO [jenkins-hbase4:43049] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 23:07:21,108 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=e55640b856f8ffb8c42b40d8dc5afc3b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:21,108 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=09386da05024281c176c399194de0545, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:21,109 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690153641108"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153641108"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153641108"}]},"ts":"1690153641108"} 2023-07-23 23:07:21,109 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690153641108"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153641108"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153641108"}]},"ts":"1690153641108"} 2023-07-23 23:07:21,111 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 09386da05024281c176c399194de0545, server=jenkins-hbase4.apache.org,38881,1690153558819}] 2023-07-23 23:07:21,112 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure e55640b856f8ffb8c42b40d8dc5afc3b, server=jenkins-hbase4.apache.org,34863,1690153558866}] 2023-07-23 23:07:21,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545. 2023-07-23 23:07:21,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b. 2023-07-23 23:07:21,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 09386da05024281c176c399194de0545, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 23:07:21,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e55640b856f8ffb8c42b40d8dc5afc3b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 23:07:21,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545. service=AccessControlService 2023-07-23 23:07:21,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b. service=AccessControlService 2023-07-23 23:07:21,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 23:07:21,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 23:07:21,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 09386da05024281c176c399194de0545 2023-07-23 23:07:21,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion e55640b856f8ffb8c42b40d8dc5afc3b 2023-07-23 23:07:21,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:07:21,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:07:21,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 09386da05024281c176c399194de0545 2023-07-23 23:07:21,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e55640b856f8ffb8c42b40d8dc5afc3b 2023-07-23 23:07:21,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 09386da05024281c176c399194de0545 2023-07-23 23:07:21,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e55640b856f8ffb8c42b40d8dc5afc3b 2023-07-23 23:07:21,275 INFO [StoreOpener-e55640b856f8ffb8c42b40d8dc5afc3b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e55640b856f8ffb8c42b40d8dc5afc3b 2023-07-23 23:07:21,275 INFO [StoreOpener-09386da05024281c176c399194de0545-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 09386da05024281c176c399194de0545 2023-07-23 23:07:21,277 DEBUG [StoreOpener-e55640b856f8ffb8c42b40d8dc5afc3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion/e55640b856f8ffb8c42b40d8dc5afc3b/cf 2023-07-23 23:07:21,277 DEBUG [StoreOpener-e55640b856f8ffb8c42b40d8dc5afc3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion/e55640b856f8ffb8c42b40d8dc5afc3b/cf 2023-07-23 23:07:21,278 INFO [StoreOpener-e55640b856f8ffb8c42b40d8dc5afc3b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e55640b856f8ffb8c42b40d8dc5afc3b columnFamilyName cf 2023-07-23 23:07:21,279 DEBUG [StoreOpener-09386da05024281c176c399194de0545-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion/09386da05024281c176c399194de0545/cf 2023-07-23 23:07:21,279 DEBUG [StoreOpener-09386da05024281c176c399194de0545-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion/09386da05024281c176c399194de0545/cf 2023-07-23 23:07:21,279 INFO [StoreOpener-09386da05024281c176c399194de0545-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 09386da05024281c176c399194de0545 columnFamilyName cf 2023-07-23 23:07:21,284 INFO [StoreOpener-e55640b856f8ffb8c42b40d8dc5afc3b-1] regionserver.HStore(310): Store=e55640b856f8ffb8c42b40d8dc5afc3b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 23:07:21,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion/e55640b856f8ffb8c42b40d8dc5afc3b 2023-07-23 23:07:21,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion/e55640b856f8ffb8c42b40d8dc5afc3b 2023-07-23 23:07:21,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e55640b856f8ffb8c42b40d8dc5afc3b 2023-07-23 23:07:21,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion/e55640b856f8ffb8c42b40d8dc5afc3b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 23:07:21,295 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e55640b856f8ffb8c42b40d8dc5afc3b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60832490, jitterRate=-0.09352526068687439}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 23:07:21,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e55640b856f8ffb8c42b40d8dc5afc3b: 2023-07-23 23:07:21,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b., pid=61, masterSystemTime=1690153641264 2023-07-23 23:07:21,298 INFO [StoreOpener-09386da05024281c176c399194de0545-1] regionserver.HStore(310): Store=09386da05024281c176c399194de0545/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 23:07:21,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b. 2023-07-23 23:07:21,299 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b. 2023-07-23 23:07:21,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion/09386da05024281c176c399194de0545 2023-07-23 23:07:21,300 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion/09386da05024281c176c399194de0545 2023-07-23 23:07:21,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 09386da05024281c176c399194de0545 2023-07-23 23:07:21,304 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=e55640b856f8ffb8c42b40d8dc5afc3b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:21,304 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690153641304"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690153641304"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690153641304"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690153641304"}]},"ts":"1690153641304"} 2023-07-23 23:07:21,309 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-23 23:07:21,309 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure e55640b856f8ffb8c42b40d8dc5afc3b, server=jenkins-hbase4.apache.org,34863,1690153558866 in 195 msec 2023-07-23 23:07:21,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion/09386da05024281c176c399194de0545/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 23:07:21,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 09386da05024281c176c399194de0545; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71800572, jitterRate=0.0699118971824646}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 23:07:21,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 09386da05024281c176c399194de0545: 2023-07-23 23:07:21,318 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545., pid=60, masterSystemTime=1690153641263 2023-07-23 23:07:21,319 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e55640b856f8ffb8c42b40d8dc5afc3b, ASSIGN in 362 msec 2023-07-23 23:07:21,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545. 2023-07-23 23:07:21,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545. 2023-07-23 23:07:21,320 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=09386da05024281c176c399194de0545, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:21,321 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690153641320"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690153641320"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690153641320"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690153641320"}]},"ts":"1690153641320"} 2023-07-23 23:07:21,327 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-23 23:07:21,327 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 09386da05024281c176c399194de0545, server=jenkins-hbase4.apache.org,38881,1690153558819 in 212 msec 2023-07-23 23:07:21,329 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-23 23:07:21,329 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=09386da05024281c176c399194de0545, ASSIGN in 380 msec 2023-07-23 23:07:21,330 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 23:07:21,330 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153641330"}]},"ts":"1690153641330"} 2023-07-23 23:07:21,332 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-23 23:07:21,335 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 23:07:21,335 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-23 23:07:21,339 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34863] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-23 23:07:21,341 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:21,341 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:21,343 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 23:07:21,343 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 23:07:21,346 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:21,346 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:21,347 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 23:07:21,347 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 23:07:21,356 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 956 msec 2023-07-23 23:07:21,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-23 23:07:21,507 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-23 23:07:21,513 DEBUG [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,513 DEBUG [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b. 2023-07-23 23:07:21,516 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 23:07:21,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 23:07:21,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690153641537 (current time:1690153641537). 2023-07-23 23:07:21,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 23:07:21,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(139): Connect 0x7fbbf512 to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:07:21,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7184921c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:07:21,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:07:21,557 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:07:21,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7fbbf512 to 127.0.0.1:58893 2023-07-23 23:07:21,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:07:21,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(139): Connect 0x72b1337c to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:07:21,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52024b5d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:07:21,567 DEBUG [hconnection-0x7c33773-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:07:21,568 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36664, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:07:21,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:07:21,575 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32862, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:07:21,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72b1337c to 127.0.0.1:58893 2023-07-23 23:07:21,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:07:21,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-23 23:07:21,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 23:07:21,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 23:07:21,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 23:07:21,584 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 23:07:21,585 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690154241585 2023-07-23 23:07:21,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 23:07:21,586 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,587 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 23:07:21,587 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 23:07:21,589 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 23:07:21,589 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 23:07:21,593 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-23 23:07:21,594 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 23:07:21,594 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690154241594 2023-07-23 23:07:21,618 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,618 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-23 23:07:21,618 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:07:21,620 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-23 23:07:21,620 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-23 23:07:21,679 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,679 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,681 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:21,681 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:21,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:21,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:21,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:21,681 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:21,682 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:21,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:21,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:21,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:21,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,683 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:21,683 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:21,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,684 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:21,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-23 23:07:21,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,684 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 23:07:21,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-23 23:07:21,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-23 23:07:21,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,684 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 23:07:21,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,684 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 23:07:21,684 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 23:07:21,686 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,687 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 23:07:21,687 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:07:21,687 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:07:21,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 23:07:21,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 23:07:21,688 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 23:07:21,689 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,690 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,690 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 23:07:21,691 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 23:07:21,691 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 23:07:21,691 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 23:07:21,691 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39259,1690153558742' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 23:07:21,691 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:07:21,691 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:07:21,693 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 23:07:21,693 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 23:07:21,693 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34863,1690153558866' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 23:07:21,694 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 23:07:21,694 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 23:07:21,694 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1690153558819' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 23:07:21,696 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,697 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:21,697 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:21,697 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,697 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:07:21,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:21,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:21,697 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,697 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:21,697 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,697 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:07:21,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:21,699 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,699 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:07:21,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:21,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:21,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:21,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:21,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:21,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34863,1690153558866' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 23:07:21,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@258ac7b6[Count = 1] remaining members to acquire global barrier 2023-07-23 23:07:21,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:21,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:21,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:21,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:21,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:21,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:21,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:21,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:21,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:21,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1690153558819' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 23:07:21,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@258ac7b6[Count = 0] remaining members to acquire global barrier 2023-07-23 23:07:21,704 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-23 23:07:21,704 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,705 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,705 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,705 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,705 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 23:07:21,705 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 23:07:21,706 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39259,1690153558742' in zk 2023-07-23 23:07:21,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,705 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:21,706 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 23:07:21,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,706 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 23:07:21,706 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:21,706 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 23:07:21,706 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 23:07:21,706 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545. 2023-07-23 23:07:21,706 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 23:07:21,706 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545. started... 2023-07-23 23:07:21,706 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b. 2023-07-23 23:07:21,706 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 23:07:21,706 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 23:07:21,706 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b. started... 2023-07-23 23:07:21,707 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 09386da05024281c176c399194de0545: 2023-07-23 23:07:21,708 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e55640b856f8ffb8c42b40d8dc5afc3b: 2023-07-23 23:07:21,708 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,708 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 23:07:21,708 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 23:07:21,708 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,708 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 23:07:21,708 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 23:07:21,710 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 23:07:21,710 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:07:21,710 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 23:07:21,719 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b. completed. 2023-07-23 23:07:21,719 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b. 2023-07-23 23:07:21,719 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 23:07:21,719 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 23:07:21,719 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:21,719 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 23:07:21,719 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34863,1690153558866' in zk 2023-07-23 23:07:21,721 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:21,721 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 23:07:21,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:21,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:21,721 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:07:21,721 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 23:07:21,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:21,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:21,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:21,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,724 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545. completed. 2023-07-23 23:07:21,724 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545. 2023-07-23 23:07:21,724 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 23:07:21,724 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 23:07:21,724 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:21,724 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 23:07:21,724 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38881,1690153558819' in zk 2023-07-23 23:07:21,726 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 23:07:21,726 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:07:21,726 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 23:07:21,727 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:21,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:21,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:21,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:21,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:21,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:21,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:21,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:21,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34863,1690153558866': 2023-07-23 23:07:21,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34863,1690153558866' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-23 23:07:21,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:21,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:21,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:21,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:21,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:21,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:21,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:21,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:21,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:21,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:21,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:21,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:21,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38881,1690153558819': 2023-07-23 23:07:21,734 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1690153558819' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-23 23:07:21,734 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-23 23:07:21,735 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 23:07:21,735 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 23:07:21,735 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,735 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 23:07:21,737 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,737 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,737 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,737 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:21,737 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:21,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:21,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:21,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:21,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:21,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:21,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:21,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:21,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,738 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:21,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,738 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,739 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:21,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,739 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:21,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:21,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:21,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:21,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,739 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:21,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:21,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:21,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:21,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:21,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,742 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:21,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:21,743 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:21,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:21,743 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:21,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:21,747 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:21,747 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,747 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:21,747 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:21,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:21,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:21,747 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:21,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:21,748 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:21,748 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:07:21,748 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:21,748 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,747 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:21,749 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,748 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:21,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:21,748 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:21,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:21,748 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:21,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:21,750 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:21,750 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,750 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:21,750 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:21,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:21,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,750 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,750 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 23:07:21,750 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:21,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:21,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:21,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:21,751 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-23 23:07:21,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,803 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,888 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:07:21,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 23:07:21,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 23:07:21,890 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 23:07:21,923 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-23 23:07:21,923 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,924 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:21,924 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690153641586Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1690153641765 (+179 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690153641765Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690153641765Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690153641773 (+8 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690153641791 (+18 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690153641923 (+132 ms) 2023-07-23 23:07:21,927 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 23:07:21,929 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 341 msec 2023-07-23 23:07:22,191 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:07:22,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 23:07:22,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 23:07:22,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34863] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 23:07:22,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 23:07:22,201 DEBUG [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,201 DEBUG [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b. 2023-07-23 23:07:22,202 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 23:07:22,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 23:07:22,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690153642214 (current time:1690153642214). 2023-07-23 23:07:22,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 23:07:22,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(139): Connect 0x2cc58698 to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:07:22,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7725aaa9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:07:22,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:07:22,262 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:07:22,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2cc58698 to 127.0.0.1:58893 2023-07-23 23:07:22,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:07:22,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(139): Connect 0x709737cd to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:07:22,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@70668e01, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:07:22,334 DEBUG [hconnection-0x2a4c1246-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:07:22,338 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36696, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:07:22,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:07:22,345 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32870, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:07:22,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x709737cd to 127.0.0.1:58893 2023-07-23 23:07:22,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:07:22,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-23 23:07:22,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 23:07:22,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 23:07:22,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 23:07:22,351 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 23:07:22,352 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690154242352 2023-07-23 23:07:22,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-23 23:07:22,352 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,353 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 23:07:22,353 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 23:07:22,355 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-23 23:07:22,355 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 23:07:22,356 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-23 23:07:22,356 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 23:07:22,357 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690154242357 2023-07-23 23:07:22,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,367 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-23 23:07:22,368 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:07:22,369 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-23 23:07:22,369 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-23 23:07:22,370 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,370 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,408 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:22,408 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:22,408 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:22,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:22,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:22,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:22,408 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:22,409 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:22,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:22,409 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:22,409 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:22,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:22,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,409 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:22,410 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 23:07:22,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,410 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,410 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,410 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-23 23:07:22,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-23 23:07:22,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,410 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 23:07:22,410 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 23:07:22,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-23 23:07:22,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,411 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,411 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-23 23:07:22,411 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 23:07:22,411 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:07:22,412 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 23:07:22,412 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 23:07:22,412 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1690153558819' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 23:07:22,413 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,413 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,413 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 23:07:22,413 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-23 23:07:22,413 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:07:22,413 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:07:22,414 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 23:07:22,415 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 23:07:22,415 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-23 23:07:22,415 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-23 23:07:22,415 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39259,1690153558742' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 23:07:22,415 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34863,1690153558866' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-23 23:07:22,447 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:22,447 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:22,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:22,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:22,454 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:07:22,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 23:07:22,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 23:07:22,455 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 23:07:22,478 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:22,478 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,478 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,478 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:07:22,478 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:22,478 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,478 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:07:22,478 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:22,478 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:07:22,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:22,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:22,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:22,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:22,480 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1690153558819' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 23:07:22,480 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a7cf848[Count = 1] remaining members to acquire global barrier 2023-07-23 23:07:22,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:22,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:22,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:22,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:22,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:22,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:22,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:22,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:22,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:22,483 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34863,1690153558866' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-23 23:07:22,483 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a7cf848[Count = 0] remaining members to acquire global barrier 2023-07-23 23:07:22,483 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-23 23:07:22,483 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,531 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,531 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,531 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,532 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 23:07:22,532 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:22,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,532 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 23:07:22,532 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 23:07:22,532 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-23 23:07:22,532 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b. 2023-07-23 23:07:22,532 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 23:07:22,532 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b. started... 2023-07-23 23:07:22,532 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:22,533 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545. 2023-07-23 23:07:22,532 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 23:07:22,533 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545. started... 2023-07-23 23:07:22,533 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 23:07:22,532 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 23:07:22,533 INFO [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HRegion(2745): Flushing e55640b856f8ffb8c42b40d8dc5afc3b 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-07-23 23:07:22,533 INFO [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 09386da05024281c176c399194de0545 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-07-23 23:07:22,533 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39259,1690153558742' in zk 2023-07-23 23:07:22,533 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 23:07:22,570 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 23:07:22,570 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:07:22,570 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 23:07:22,575 INFO [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230723162e5a81f5ff43e8a80082cb208f4ff4 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230723162e5a81f5ff43e8a80082cb208f4ff4 2023-07-23 23:07:22,579 INFO [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230723037492cfb1484b088074f8bfef9fc7c6 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230723037492cfb1484b088074f8bfef9fc7c6 2023-07-23 23:07:22,599 INFO [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=467, hasBloomFilter=true, into tmp file hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion/e55640b856f8ffb8c42b40d8dc5afc3b/.tmp/cf/615194f95b6d48cab858d09e78dc60c3 2023-07-23 23:07:22,602 INFO [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.8 K, hasBloomFilter=true, into tmp file hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion/09386da05024281c176c399194de0545/.tmp/cf/4807ebb916454b1fa96612d16975b6c5 2023-07-23 23:07:22,606 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion/e55640b856f8ffb8c42b40d8dc5afc3b/.tmp/cf/615194f95b6d48cab858d09e78dc60c3 as hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion/e55640b856f8ffb8c42b40d8dc5afc3b/cf/615194f95b6d48cab858d09e78dc60c3 2023-07-23 23:07:22,608 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion/09386da05024281c176c399194de0545/.tmp/cf/4807ebb916454b1fa96612d16975b6c5 as hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion/09386da05024281c176c399194de0545/cf/4807ebb916454b1fa96612d16975b6c5 2023-07-23 23:07:22,612 INFO [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion/e55640b856f8ffb8c42b40d8dc5afc3b/cf/615194f95b6d48cab858d09e78dc60c3, entries=7, sequenceid=6, filesize=6.2 K 2023-07-23 23:07:22,615 INFO [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for e55640b856f8ffb8c42b40d8dc5afc3b in 82ms, sequenceid=6, compaction requested=false 2023-07-23 23:07:22,615 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-23 23:07:22,615 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for e55640b856f8ffb8c42b40d8dc5afc3b: 2023-07-23 23:07:22,616 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,616 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 23:07:22,616 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion/e55640b856f8ffb8c42b40d8dc5afc3b/cf/615194f95b6d48cab858d09e78dc60c3] hfiles 2023-07-23 23:07:22,616 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion/e55640b856f8ffb8c42b40d8dc5afc3b/cf/615194f95b6d48cab858d09e78dc60c3 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,616 INFO [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion/09386da05024281c176c399194de0545/cf/4807ebb916454b1fa96612d16975b6c5, entries=43, sequenceid=6, filesize=12.8 K 2023-07-23 23:07:22,619 INFO [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for 09386da05024281c176c399194de0545 in 86ms, sequenceid=6, compaction requested=false 2023-07-23 23:07:22,621 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 09386da05024281c176c399194de0545: 2023-07-23 23:07:22,621 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,621 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 23:07:22,621 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion/09386da05024281c176c399194de0545/cf/4807ebb916454b1fa96612d16975b6c5] hfiles 2023-07-23 23:07:22,621 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion/09386da05024281c176c399194de0545/cf/4807ebb916454b1fa96612d16975b6c5 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,635 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b. completed. 2023-07-23 23:07:22,635 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b. 2023-07-23 23:07:22,635 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 23:07:22,635 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 23:07:22,635 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:22,638 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 23:07:22,639 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34863,1690153558866' in zk 2023-07-23 23:07:22,641 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545. completed. 2023-07-23 23:07:22,641 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545. 2023-07-23 23:07:22,642 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 23:07:22,642 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 23:07:22,642 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:22,642 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-23 23:07:22,642 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38881,1690153558819' in zk 2023-07-23 23:07:22,655 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:22,655 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 23:07:22,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:22,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:22,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:22,655 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:07:22,655 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:07:22,655 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 23:07:22,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 23:07:22,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 23:07:22,658 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 23:07:22,701 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-23 23:07:22,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:22,701 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:22,701 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:07:22,701 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-23 23:07:22,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:22,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:22,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:22,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:22,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:22,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:22,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:22,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:22,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,34863,1690153558866': 2023-07-23 23:07:22,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34863,1690153558866' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-23 23:07:22,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:22,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:22,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:22,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:22,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:22,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:22,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:22,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:22,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:22,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:22,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:22,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:22,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38881,1690153558819': 2023-07-23 23:07:22,712 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1690153558819' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-23 23:07:22,712 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-23 23:07:22,712 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 23:07:22,712 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 23:07:22,712 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,713 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 23:07:22,855 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,855 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:22,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:22,855 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,855 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:22,855 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,855 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:22,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,856 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:22,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,855 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:22,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:22,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:22,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:22,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:22,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:22,856 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:22,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:22,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:22,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,857 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:22,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:22,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:22,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:22,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:22,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:22,859 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:22,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,860 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:22,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:22,860 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:22,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:22,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:22,901 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:22,901 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:22,901 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:22,901 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:22,901 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:22,901 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:22,901 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:07:22,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:22,903 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,901 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:22,903 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:22,903 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,903 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:22,901 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:22,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:22,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:22,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:22,903 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,903 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:22,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:22,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:22,903 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 23:07:22,904 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:22,904 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,904 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:22,904 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:22,904 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,904 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230723037492cfb1484b088074f8bfef9fc7c6, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230723162e5a81f5ff43e8a80082cb208f4ff4] mob files 2023-07-23 23:07:22,907 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230723037492cfb1484b088074f8bfef9fc7c6 2023-07-23 23:07:22,908 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230723162e5a81f5ff43e8a80082cb208f4ff4 2023-07-23 23:07:22,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:22,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:22,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:22,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:22,947 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,948 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:22,959 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:07:22,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 23:07:22,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-23 23:07:22,960 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-23 23:07:23,005 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:23,037 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-23 23:07:23,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:23,037 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:23,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690153642352Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1690153642947 (+595 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690153642947Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1690153642947Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1690153642956 (+9 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690153642994 (+38 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690153643037 (+43 ms) 2023-07-23 23:07:23,040 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-23 23:07:23,042 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 687 msec 2023-07-23 23:07:23,461 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:07:23,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-23 23:07:23,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 23:07:23,500 DEBUG [Listener at jenkins-hbase4.apache.org/42491] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 23:07:23,508 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32878, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 23:07:23,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34863] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-23 23:07:23,511 DEBUG [Listener at jenkins-hbase4.apache.org/42491] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 23:07:23,520 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 23:07:23,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-23 23:07:23,522 DEBUG [Listener at jenkins-hbase4.apache.org/42491] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-23 23:07:23,524 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56212, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-23 23:07:23,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39259] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-23 23:07:23,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-23 23:07:23,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:23,533 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 23:07:23,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-23 23:07:23,533 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 23:07:23,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 23:07:23,536 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a0739458bf8192107b3d997db8651b6 2023-07-23 23:07:23,538 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a0739458bf8192107b3d997db8651b6 empty. 2023-07-23 23:07:23,538 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/acd9bf1507d94b90512cc1e9c3cdbfbf 2023-07-23 23:07:23,540 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a0739458bf8192107b3d997db8651b6 2023-07-23 23:07:23,541 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/acd9bf1507d94b90512cc1e9c3cdbfbf empty. 2023-07-23 23:07:23,541 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/acd9bf1507d94b90512cc1e9c3cdbfbf 2023-07-23 23:07:23,541 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-23 23:07:23,563 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-23 23:07:23,565 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => acd9bf1507d94b90512cc1e9c3cdbfbf, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690153643529.acd9bf1507d94b90512cc1e9c3cdbfbf.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp 2023-07-23 23:07:23,565 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7a0739458bf8192107b3d997db8651b6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643529.7a0739458bf8192107b3d997db8651b6.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp 2023-07-23 23:07:23,596 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690153643529.acd9bf1507d94b90512cc1e9c3cdbfbf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:07:23,596 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing acd9bf1507d94b90512cc1e9c3cdbfbf, disabling compactions & flushes 2023-07-23 23:07:23,596 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690153643529.acd9bf1507d94b90512cc1e9c3cdbfbf. 2023-07-23 23:07:23,596 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690153643529.acd9bf1507d94b90512cc1e9c3cdbfbf. 2023-07-23 23:07:23,597 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690153643529.acd9bf1507d94b90512cc1e9c3cdbfbf. after waiting 0 ms 2023-07-23 23:07:23,597 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690153643529.acd9bf1507d94b90512cc1e9c3cdbfbf. 2023-07-23 23:07:23,597 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690153643529.acd9bf1507d94b90512cc1e9c3cdbfbf. 2023-07-23 23:07:23,597 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for acd9bf1507d94b90512cc1e9c3cdbfbf: 2023-07-23 23:07:23,597 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643529.7a0739458bf8192107b3d997db8651b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:07:23,597 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 7a0739458bf8192107b3d997db8651b6, disabling compactions & flushes 2023-07-23 23:07:23,597 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643529.7a0739458bf8192107b3d997db8651b6. 2023-07-23 23:07:23,597 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643529.7a0739458bf8192107b3d997db8651b6. 2023-07-23 23:07:23,597 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643529.7a0739458bf8192107b3d997db8651b6. after waiting 0 ms 2023-07-23 23:07:23,597 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643529.7a0739458bf8192107b3d997db8651b6. 2023-07-23 23:07:23,597 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643529.7a0739458bf8192107b3d997db8651b6. 2023-07-23 23:07:23,598 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 7a0739458bf8192107b3d997db8651b6: 2023-07-23 23:07:23,600 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 23:07:23,601 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690153643529.acd9bf1507d94b90512cc1e9c3cdbfbf.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690153643601"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153643601"}]},"ts":"1690153643601"} 2023-07-23 23:07:23,601 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643529.7a0739458bf8192107b3d997db8651b6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690153643601"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153643601"}]},"ts":"1690153643601"} 2023-07-23 23:07:23,604 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 23:07:23,605 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 23:07:23,605 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153643605"}]},"ts":"1690153643605"} 2023-07-23 23:07:23,606 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-23 23:07:23,609 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 23:07:23,610 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 23:07:23,610 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 23:07:23,610 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 23:07:23,610 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 23:07:23,611 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7a0739458bf8192107b3d997db8651b6, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=acd9bf1507d94b90512cc1e9c3cdbfbf, ASSIGN}] 2023-07-23 23:07:23,614 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7a0739458bf8192107b3d997db8651b6, ASSIGN 2023-07-23 23:07:23,614 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=acd9bf1507d94b90512cc1e9c3cdbfbf, ASSIGN 2023-07-23 23:07:23,615 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7a0739458bf8192107b3d997db8651b6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39259,1690153558742; forceNewPlan=false, retain=false 2023-07-23 23:07:23,615 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=acd9bf1507d94b90512cc1e9c3cdbfbf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1690153558819; forceNewPlan=false, retain=false 2023-07-23 23:07:23,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 23:07:23,766 INFO [jenkins-hbase4:43049] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 23:07:23,769 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=7a0739458bf8192107b3d997db8651b6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:23,769 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=acd9bf1507d94b90512cc1e9c3cdbfbf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:23,769 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643529.7a0739458bf8192107b3d997db8651b6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690153643769"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153643769"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153643769"}]},"ts":"1690153643769"} 2023-07-23 23:07:23,769 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690153643529.acd9bf1507d94b90512cc1e9c3cdbfbf.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690153643769"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153643769"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153643769"}]},"ts":"1690153643769"} 2023-07-23 23:07:23,773 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 7a0739458bf8192107b3d997db8651b6, server=jenkins-hbase4.apache.org,39259,1690153558742}] 2023-07-23 23:07:23,774 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure acd9bf1507d94b90512cc1e9c3cdbfbf, server=jenkins-hbase4.apache.org,38881,1690153558819}] 2023-07-23 23:07:23,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 23:07:23,929 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0004_000001 (auth:SIMPLE) 2023-07-23 23:07:23,936 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1690153643529.acd9bf1507d94b90512cc1e9c3cdbfbf. 2023-07-23 23:07:23,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => acd9bf1507d94b90512cc1e9c3cdbfbf, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690153643529.acd9bf1507d94b90512cc1e9c3cdbfbf.', STARTKEY => '2', ENDKEY => ''} 2023-07-23 23:07:23,936 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1690153643529.acd9bf1507d94b90512cc1e9c3cdbfbf. service=AccessControlService 2023-07-23 23:07:23,937 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 23:07:23,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 acd9bf1507d94b90512cc1e9c3cdbfbf 2023-07-23 23:07:23,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690153643529.acd9bf1507d94b90512cc1e9c3cdbfbf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:07:23,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for acd9bf1507d94b90512cc1e9c3cdbfbf 2023-07-23 23:07:23,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for acd9bf1507d94b90512cc1e9c3cdbfbf 2023-07-23 23:07:23,937 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643529.7a0739458bf8192107b3d997db8651b6. 2023-07-23 23:07:23,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7a0739458bf8192107b3d997db8651b6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643529.7a0739458bf8192107b3d997db8651b6.', STARTKEY => '', ENDKEY => '2'} 2023-07-23 23:07:23,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643529.7a0739458bf8192107b3d997db8651b6. service=AccessControlService 2023-07-23 23:07:23,938 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 23:07:23,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 7a0739458bf8192107b3d997db8651b6 2023-07-23 23:07:23,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643529.7a0739458bf8192107b3d997db8651b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:07:23,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7a0739458bf8192107b3d997db8651b6 2023-07-23 23:07:23,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7a0739458bf8192107b3d997db8651b6 2023-07-23 23:07:23,942 INFO [StoreOpener-acd9bf1507d94b90512cc1e9c3cdbfbf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region acd9bf1507d94b90512cc1e9c3cdbfbf 2023-07-23 23:07:23,943 INFO [StoreOpener-7a0739458bf8192107b3d997db8651b6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7a0739458bf8192107b3d997db8651b6 2023-07-23 23:07:23,944 DEBUG [StoreOpener-7a0739458bf8192107b3d997db8651b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a0739458bf8192107b3d997db8651b6/cf 2023-07-23 23:07:23,944 DEBUG [StoreOpener-7a0739458bf8192107b3d997db8651b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a0739458bf8192107b3d997db8651b6/cf 2023-07-23 23:07:23,945 INFO [StoreOpener-7a0739458bf8192107b3d997db8651b6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a0739458bf8192107b3d997db8651b6 columnFamilyName cf 2023-07-23 23:07:23,945 DEBUG [StoreOpener-acd9bf1507d94b90512cc1e9c3cdbfbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/acd9bf1507d94b90512cc1e9c3cdbfbf/cf 2023-07-23 23:07:23,945 DEBUG [StoreOpener-acd9bf1507d94b90512cc1e9c3cdbfbf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/acd9bf1507d94b90512cc1e9c3cdbfbf/cf 2023-07-23 23:07:23,946 INFO [StoreOpener-acd9bf1507d94b90512cc1e9c3cdbfbf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region acd9bf1507d94b90512cc1e9c3cdbfbf columnFamilyName cf 2023-07-23 23:07:23,946 INFO [StoreOpener-7a0739458bf8192107b3d997db8651b6-1] regionserver.HStore(310): Store=7a0739458bf8192107b3d997db8651b6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 23:07:23,946 INFO [StoreOpener-acd9bf1507d94b90512cc1e9c3cdbfbf-1] regionserver.HStore(310): Store=acd9bf1507d94b90512cc1e9c3cdbfbf/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 23:07:23,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a0739458bf8192107b3d997db8651b6 2023-07-23 23:07:23,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a0739458bf8192107b3d997db8651b6 2023-07-23 23:07:23,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/acd9bf1507d94b90512cc1e9c3cdbfbf 2023-07-23 23:07:23,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/acd9bf1507d94b90512cc1e9c3cdbfbf 2023-07-23 23:07:23,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7a0739458bf8192107b3d997db8651b6 2023-07-23 23:07:23,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for acd9bf1507d94b90512cc1e9c3cdbfbf 2023-07-23 23:07:23,954 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a0739458bf8192107b3d997db8651b6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 23:07:23,955 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7a0739458bf8192107b3d997db8651b6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60856806, jitterRate=-0.09316292405128479}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 23:07:23,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7a0739458bf8192107b3d997db8651b6: 2023-07-23 23:07:23,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/acd9bf1507d94b90512cc1e9c3cdbfbf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 23:07:23,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643529.7a0739458bf8192107b3d997db8651b6., pid=69, masterSystemTime=1690153643925 2023-07-23 23:07:23,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened acd9bf1507d94b90512cc1e9c3cdbfbf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73258279, jitterRate=0.09163342416286469}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 23:07:23,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for acd9bf1507d94b90512cc1e9c3cdbfbf: 2023-07-23 23:07:23,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690153643529.acd9bf1507d94b90512cc1e9c3cdbfbf., pid=70, masterSystemTime=1690153643926 2023-07-23 23:07:23,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643529.7a0739458bf8192107b3d997db8651b6. 2023-07-23 23:07:23,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643529.7a0739458bf8192107b3d997db8651b6. 2023-07-23 23:07:23,959 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=7a0739458bf8192107b3d997db8651b6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:23,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690153643529.acd9bf1507d94b90512cc1e9c3cdbfbf. 2023-07-23 23:07:23,959 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1690153643529.acd9bf1507d94b90512cc1e9c3cdbfbf. 2023-07-23 23:07:23,959 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643529.7a0739458bf8192107b3d997db8651b6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690153643959"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690153643959"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690153643959"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690153643959"}]},"ts":"1690153643959"} 2023-07-23 23:07:23,960 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=acd9bf1507d94b90512cc1e9c3cdbfbf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:23,960 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690153643529.acd9bf1507d94b90512cc1e9c3cdbfbf.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690153643960"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690153643960"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690153643960"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690153643960"}]},"ts":"1690153643960"} 2023-07-23 23:07:23,964 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-23 23:07:23,964 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 7a0739458bf8192107b3d997db8651b6, server=jenkins-hbase4.apache.org,39259,1690153558742 in 188 msec 2023-07-23 23:07:23,965 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-23 23:07:23,965 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure acd9bf1507d94b90512cc1e9c3cdbfbf, server=jenkins-hbase4.apache.org,38881,1690153558819 in 187 msec 2023-07-23 23:07:23,968 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7a0739458bf8192107b3d997db8651b6, ASSIGN in 353 msec 2023-07-23 23:07:23,969 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-23 23:07:23,969 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=acd9bf1507d94b90512cc1e9c3cdbfbf, ASSIGN in 354 msec 2023-07-23 23:07:23,970 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 23:07:23,970 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153643970"}]},"ts":"1690153643970"} 2023-07-23 23:07:23,971 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-23 23:07:23,973 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 23:07:23,974 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-23 23:07:23,976 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34863] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-23 23:07:23,979 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:23,979 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:23,979 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:23,979 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:23,980 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 23:07:23,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 23:07:23,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 23:07:23,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 23:07:23,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 23:07:23,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 23:07:23,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 23:07:23,981 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-23 23:07:23,982 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 451 msec 2023-07-23 23:07:24,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-23 23:07:24,138 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-23 23:07:24,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 7a0739458bf8192107b3d997db8651b6, acd9bf1507d94b90512cc1e9c3cdbfbf 2023-07-23 23:07:24,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7a0739458bf8192107b3d997db8651b6, acd9bf1507d94b90512cc1e9c3cdbfbf], force=true 2023-07-23 23:07:24,191 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7a0739458bf8192107b3d997db8651b6, acd9bf1507d94b90512cc1e9c3cdbfbf], force=true 2023-07-23 23:07:24,192 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7a0739458bf8192107b3d997db8651b6, acd9bf1507d94b90512cc1e9c3cdbfbf], force=true 2023-07-23 23:07:24,192 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7a0739458bf8192107b3d997db8651b6, acd9bf1507d94b90512cc1e9c3cdbfbf], force=true 2023-07-23 23:07:24,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 23:07:24,219 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7a0739458bf8192107b3d997db8651b6, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=acd9bf1507d94b90512cc1e9c3cdbfbf, UNASSIGN}] 2023-07-23 23:07:24,222 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7a0739458bf8192107b3d997db8651b6, UNASSIGN 2023-07-23 23:07:24,222 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=acd9bf1507d94b90512cc1e9c3cdbfbf, UNASSIGN 2023-07-23 23:07:24,223 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=acd9bf1507d94b90512cc1e9c3cdbfbf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:24,223 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=7a0739458bf8192107b3d997db8651b6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:24,223 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690153643529.acd9bf1507d94b90512cc1e9c3cdbfbf.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690153644223"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153644223"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153644223"}]},"ts":"1690153644223"} 2023-07-23 23:07:24,223 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643529.7a0739458bf8192107b3d997db8651b6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690153644223"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153644223"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153644223"}]},"ts":"1690153644223"} 2023-07-23 23:07:24,225 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure acd9bf1507d94b90512cc1e9c3cdbfbf, server=jenkins-hbase4.apache.org,38881,1690153558819}] 2023-07-23 23:07:24,226 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 7a0739458bf8192107b3d997db8651b6, server=jenkins-hbase4.apache.org,39259,1690153558742}] 2023-07-23 23:07:24,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 23:07:24,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close acd9bf1507d94b90512cc1e9c3cdbfbf 2023-07-23 23:07:24,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing acd9bf1507d94b90512cc1e9c3cdbfbf, disabling compactions & flushes 2023-07-23 23:07:24,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690153643529.acd9bf1507d94b90512cc1e9c3cdbfbf. 2023-07-23 23:07:24,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690153643529.acd9bf1507d94b90512cc1e9c3cdbfbf. 2023-07-23 23:07:24,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690153643529.acd9bf1507d94b90512cc1e9c3cdbfbf. after waiting 0 ms 2023-07-23 23:07:24,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690153643529.acd9bf1507d94b90512cc1e9c3cdbfbf. 2023-07-23 23:07:24,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing acd9bf1507d94b90512cc1e9c3cdbfbf 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-23 23:07:24,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7a0739458bf8192107b3d997db8651b6 2023-07-23 23:07:24,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7a0739458bf8192107b3d997db8651b6, disabling compactions & flushes 2023-07-23 23:07:24,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643529.7a0739458bf8192107b3d997db8651b6. 2023-07-23 23:07:24,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643529.7a0739458bf8192107b3d997db8651b6. 2023-07-23 23:07:24,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643529.7a0739458bf8192107b3d997db8651b6. after waiting 0 ms 2023-07-23 23:07:24,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643529.7a0739458bf8192107b3d997db8651b6. 2023-07-23 23:07:24,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7a0739458bf8192107b3d997db8651b6 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-23 23:07:24,407 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/acd9bf1507d94b90512cc1e9c3cdbfbf/.tmp/cf/a6a8022ab9644443b19c1ddb2eabad4e 2023-07-23 23:07:24,407 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a0739458bf8192107b3d997db8651b6/.tmp/cf/1f738c379d6745e695d111cc89863398 2023-07-23 23:07:24,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/acd9bf1507d94b90512cc1e9c3cdbfbf/.tmp/cf/a6a8022ab9644443b19c1ddb2eabad4e as hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/acd9bf1507d94b90512cc1e9c3cdbfbf/cf/a6a8022ab9644443b19c1ddb2eabad4e 2023-07-23 23:07:24,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a0739458bf8192107b3d997db8651b6/.tmp/cf/1f738c379d6745e695d111cc89863398 as hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a0739458bf8192107b3d997db8651b6/cf/1f738c379d6745e695d111cc89863398 2023-07-23 23:07:24,424 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/acd9bf1507d94b90512cc1e9c3cdbfbf/cf/a6a8022ab9644443b19c1ddb2eabad4e, entries=1, sequenceid=5, filesize=4.7 K 2023-07-23 23:07:24,425 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for acd9bf1507d94b90512cc1e9c3cdbfbf in 44ms, sequenceid=5, compaction requested=false 2023-07-23 23:07:24,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-23 23:07:24,431 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a0739458bf8192107b3d997db8651b6/cf/1f738c379d6745e695d111cc89863398, entries=1, sequenceid=5, filesize=4.7 K 2023-07-23 23:07:24,432 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 7a0739458bf8192107b3d997db8651b6 in 49ms, sequenceid=5, compaction requested=false 2023-07-23 23:07:24,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/acd9bf1507d94b90512cc1e9c3cdbfbf/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-23 23:07:24,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:07:24,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690153643529.acd9bf1507d94b90512cc1e9c3cdbfbf. 2023-07-23 23:07:24,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for acd9bf1507d94b90512cc1e9c3cdbfbf: 2023-07-23 23:07:24,447 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a0739458bf8192107b3d997db8651b6/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-23 23:07:24,447 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed acd9bf1507d94b90512cc1e9c3cdbfbf 2023-07-23 23:07:24,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:07:24,448 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=acd9bf1507d94b90512cc1e9c3cdbfbf, regionState=CLOSED 2023-07-23 23:07:24,448 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643529.7a0739458bf8192107b3d997db8651b6. 2023-07-23 23:07:24,448 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7a0739458bf8192107b3d997db8651b6: 2023-07-23 23:07:24,448 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690153643529.acd9bf1507d94b90512cc1e9c3cdbfbf.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690153644448"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153644448"}]},"ts":"1690153644448"} 2023-07-23 23:07:24,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7a0739458bf8192107b3d997db8651b6 2023-07-23 23:07:24,450 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=7a0739458bf8192107b3d997db8651b6, regionState=CLOSED 2023-07-23 23:07:24,450 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643529.7a0739458bf8192107b3d997db8651b6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690153644450"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153644450"}]},"ts":"1690153644450"} 2023-07-23 23:07:24,452 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-23 23:07:24,452 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure acd9bf1507d94b90512cc1e9c3cdbfbf, server=jenkins-hbase4.apache.org,38881,1690153558819 in 225 msec 2023-07-23 23:07:24,454 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=acd9bf1507d94b90512cc1e9c3cdbfbf, UNASSIGN in 234 msec 2023-07-23 23:07:24,455 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-23 23:07:24,455 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 7a0739458bf8192107b3d997db8651b6, server=jenkins-hbase4.apache.org,39259,1690153558742 in 227 msec 2023-07-23 23:07:24,457 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-23 23:07:24,458 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7a0739458bf8192107b3d997db8651b6, UNASSIGN in 240 msec 2023-07-23 23:07:24,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 23:07:24,539 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8e7bcbf313fb0bb90bdb146b9740eb22/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-23 23:07:24,541 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643529.7a0739458bf8192107b3d997db8651b6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-23 23:07:24,542 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690153643529.acd9bf1507d94b90512cc1e9c3cdbfbf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-23 23:07:24,542 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643530.8e7bcbf313fb0bb90bdb146b9740eb22.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-23 23:07:24,597 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8e7bcbf313fb0bb90bdb146b9740eb22, ASSIGN}] 2023-07-23 23:07:24,598 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8e7bcbf313fb0bb90bdb146b9740eb22, ASSIGN 2023-07-23 23:07:24,599 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8e7bcbf313fb0bb90bdb146b9740eb22, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,39259,1690153558742; forceNewPlan=false, retain=false 2023-07-23 23:07:24,749 INFO [jenkins-hbase4:43049] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-23 23:07:24,752 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=8e7bcbf313fb0bb90bdb146b9740eb22, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:24,752 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643530.8e7bcbf313fb0bb90bdb146b9740eb22.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690153644752"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153644752"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153644752"}]},"ts":"1690153644752"} 2023-07-23 23:07:24,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 8e7bcbf313fb0bb90bdb146b9740eb22, server=jenkins-hbase4.apache.org,39259,1690153558742}] 2023-07-23 23:07:24,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 23:07:24,923 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643530.8e7bcbf313fb0bb90bdb146b9740eb22. 2023-07-23 23:07:24,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8e7bcbf313fb0bb90bdb146b9740eb22, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643530.8e7bcbf313fb0bb90bdb146b9740eb22.', STARTKEY => '', ENDKEY => ''} 2023-07-23 23:07:24,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643530.8e7bcbf313fb0bb90bdb146b9740eb22. service=AccessControlService 2023-07-23 23:07:24,924 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 23:07:24,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 8e7bcbf313fb0bb90bdb146b9740eb22 2023-07-23 23:07:24,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643530.8e7bcbf313fb0bb90bdb146b9740eb22.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:07:24,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8e7bcbf313fb0bb90bdb146b9740eb22 2023-07-23 23:07:24,924 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8e7bcbf313fb0bb90bdb146b9740eb22 2023-07-23 23:07:24,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8e7bcbf313fb0bb90bdb146b9740eb22/.regioninfo 2023-07-23 23:07:24,952 INFO [StoreOpener-8e7bcbf313fb0bb90bdb146b9740eb22-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8e7bcbf313fb0bb90bdb146b9740eb22 2023-07-23 23:07:24,953 DEBUG [StoreOpener-8e7bcbf313fb0bb90bdb146b9740eb22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8e7bcbf313fb0bb90bdb146b9740eb22/cf 2023-07-23 23:07:24,953 DEBUG [StoreOpener-8e7bcbf313fb0bb90bdb146b9740eb22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8e7bcbf313fb0bb90bdb146b9740eb22/cf 2023-07-23 23:07:24,954 INFO [StoreOpener-8e7bcbf313fb0bb90bdb146b9740eb22-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8e7bcbf313fb0bb90bdb146b9740eb22 columnFamilyName cf 2023-07-23 23:07:25,001 DEBUG [StoreOpener-8e7bcbf313fb0bb90bdb146b9740eb22-1] regionserver.HStore(539): loaded hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8e7bcbf313fb0bb90bdb146b9740eb22/cf/1f738c379d6745e695d111cc89863398.7a0739458bf8192107b3d997db8651b6->hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a0739458bf8192107b3d997db8651b6/cf/1f738c379d6745e695d111cc89863398-top 2023-07-23 23:07:25,008 DEBUG [StoreOpener-8e7bcbf313fb0bb90bdb146b9740eb22-1] regionserver.HStore(539): loaded hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8e7bcbf313fb0bb90bdb146b9740eb22/cf/a6a8022ab9644443b19c1ddb2eabad4e.acd9bf1507d94b90512cc1e9c3cdbfbf->hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/acd9bf1507d94b90512cc1e9c3cdbfbf/cf/a6a8022ab9644443b19c1ddb2eabad4e-top 2023-07-23 23:07:25,009 INFO [StoreOpener-8e7bcbf313fb0bb90bdb146b9740eb22-1] regionserver.HStore(310): Store=8e7bcbf313fb0bb90bdb146b9740eb22/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 23:07:25,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8e7bcbf313fb0bb90bdb146b9740eb22 2023-07-23 23:07:25,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8e7bcbf313fb0bb90bdb146b9740eb22 2023-07-23 23:07:25,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8e7bcbf313fb0bb90bdb146b9740eb22 2023-07-23 23:07:25,016 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8e7bcbf313fb0bb90bdb146b9740eb22; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73342341, jitterRate=0.0928860455751419}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 23:07:25,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8e7bcbf313fb0bb90bdb146b9740eb22: 2023-07-23 23:07:25,017 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643530.8e7bcbf313fb0bb90bdb146b9740eb22., pid=77, masterSystemTime=1690153644912 2023-07-23 23:07:25,018 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643530.8e7bcbf313fb0bb90bdb146b9740eb22.,because compaction is disabled. 2023-07-23 23:07:25,023 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643530.8e7bcbf313fb0bb90bdb146b9740eb22. 2023-07-23 23:07:25,023 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643530.8e7bcbf313fb0bb90bdb146b9740eb22. 2023-07-23 23:07:25,024 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=8e7bcbf313fb0bb90bdb146b9740eb22, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:25,024 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643530.8e7bcbf313fb0bb90bdb146b9740eb22.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690153645024"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690153645024"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690153645024"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690153645024"}]},"ts":"1690153645024"} 2023-07-23 23:07:25,027 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-23 23:07:25,028 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 8e7bcbf313fb0bb90bdb146b9740eb22, server=jenkins-hbase4.apache.org,39259,1690153558742 in 268 msec 2023-07-23 23:07:25,030 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-23 23:07:25,030 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8e7bcbf313fb0bb90bdb146b9740eb22, ASSIGN in 431 msec 2023-07-23 23:07:25,035 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[7a0739458bf8192107b3d997db8651b6, acd9bf1507d94b90512cc1e9c3cdbfbf], force=true in 846 msec 2023-07-23 23:07:25,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-23 23:07:25,300 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-23 23:07:25,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-23 23:07:25,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690153645301 (current time:1690153645301). 2023-07-23 23:07:25,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 23:07:25,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(139): Connect 0x152d1d91 to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:07:25,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d1a1ee9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:07:25,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:07:25,338 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36710, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:07:25,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x152d1d91 to 127.0.0.1:58893 2023-07-23 23:07:25,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:07:25,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(139): Connect 0x39dcba06 to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:07:25,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44e0f939, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:07:25,455 DEBUG [hconnection-0x39704a1a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:07:25,459 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36724, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:07:25,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:07:25,468 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32880, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:07:25,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39dcba06 to 127.0.0.1:58893 2023-07-23 23:07:25,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:07:25,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-23 23:07:25,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 23:07:25,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-23 23:07:25,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-23 23:07:25,473 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-23 23:07:25,474 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1690154245474 2023-07-23 23:07:25,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-23 23:07:25,474 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,479 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 23:07:25,479 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 23:07:25,480 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-23 23:07:25,481 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-23 23:07:25,487 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 9 msec 2023-07-23 23:07:25,488 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-23 23:07:25,490 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1690154245490 2023-07-23 23:07:25,522 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,522 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-23 23:07:25,522 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:07:25,524 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-23 23:07:25,524 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-23 23:07:25,525 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,525 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,527 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:25,527 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:25,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:25,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:25,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:25,527 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:25,527 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:25,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:25,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:25,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:25,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,527 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:25,527 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 23:07:25,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,528 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-23 23:07:25,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,529 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-23 23:07:25,529 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,529 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-23 23:07:25,529 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:07:25,531 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-23 23:07:25,531 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-23 23:07:25,531 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1690153558819' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-23 23:07:25,533 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,533 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,534 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:07:25,539 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-23 23:07:25,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,539 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-23 23:07:25,542 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,542 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,543 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-23 23:07:25,543 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:07:25,544 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-23 23:07:25,544 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-23 23:07:25,544 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34863,1690153558866' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-23 23:07:25,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-23 23:07:25,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,545 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-23 23:07:25,546 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,547 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-23 23:07:25,547 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:07:25,548 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-23 23:07:25,549 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-23 23:07:25,549 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39259,1690153558742' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-23 23:07:25,553 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,553 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,554 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,554 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:07:25,554 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:25,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:25,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:25,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:25,555 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,555 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:07:25,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:25,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:25,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:25,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:25,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:25,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:25,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39259,1690153558742' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-23 23:07:25,558 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76eb9bac[Count = 0] remaining members to acquire global barrier 2023-07-23 23:07:25,558 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-23 23:07:25,558 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,560 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,560 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,560 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,560 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,560 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:25,560 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-23 23:07:25,560 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-23 23:07:25,560 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,38881,1690153558819' in zk 2023-07-23 23:07:25,560 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 23:07:25,560 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-23 23:07:25,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,561 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-23 23:07:25,561 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-23 23:07:25,561 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643530.8e7bcbf313fb0bb90bdb146b9740eb22. 2023-07-23 23:07:25,561 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 23:07:25,561 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34863,1690153558866' in zk 2023-07-23 23:07:25,561 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643530.8e7bcbf313fb0bb90bdb146b9740eb22. started... 2023-07-23 23:07:25,561 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 23:07:25,563 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8e7bcbf313fb0bb90bdb146b9740eb22: 2023-07-23 23:07:25,563 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-23 23:07:25,563 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:07:25,563 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-23 23:07:25,564 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643530.8e7bcbf313fb0bb90bdb146b9740eb22.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,564 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 23:07:25,565 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8e7bcbf313fb0bb90bdb146b9740eb22/cf/1f738c379d6745e695d111cc89863398.7a0739458bf8192107b3d997db8651b6->hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a0739458bf8192107b3d997db8651b6/cf/1f738c379d6745e695d111cc89863398-top, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8e7bcbf313fb0bb90bdb146b9740eb22/cf/a6a8022ab9644443b19c1ddb2eabad4e.acd9bf1507d94b90512cc1e9c3cdbfbf->hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/acd9bf1507d94b90512cc1e9c3cdbfbf/cf/a6a8022ab9644443b19c1ddb2eabad4e-top] hfiles 2023-07-23 23:07:25,565 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8e7bcbf313fb0bb90bdb146b9740eb22/cf/1f738c379d6745e695d111cc89863398.7a0739458bf8192107b3d997db8651b6 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,565 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-23 23:07:25,565 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8e7bcbf313fb0bb90bdb146b9740eb22/cf/a6a8022ab9644443b19c1ddb2eabad4e.acd9bf1507d94b90512cc1e9c3cdbfbf for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,565 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:07:25,566 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-23 23:07:25,579 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:07:25,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-23 23:07:25,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-23 23:07:25,581 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 23:07:25,594 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643530.8e7bcbf313fb0bb90bdb146b9740eb22. completed. 2023-07-23 23:07:25,594 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643530.8e7bcbf313fb0bb90bdb146b9740eb22. 2023-07-23 23:07:25,594 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 23:07:25,595 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 23:07:25,595 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:25,595 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-23 23:07:25,595 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39259,1690153558742' in zk 2023-07-23 23:07:25,606 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-23 23:07:25,606 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:25,606 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:07:25,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:25,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:25,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:25,606 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-23 23:07:25,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:25,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:25,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:25,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:25,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:25,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:25,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:25,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:25,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:25,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,39259,1690153558742': 2023-07-23 23:07:25,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39259,1690153558742' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-23 23:07:25,611 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-23 23:07:25,611 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 23:07:25,611 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 23:07:25,611 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,611 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 23:07:25,613 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,614 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:25,614 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,614 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,614 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:25,614 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:25,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,615 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:25,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:25,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:25,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:25,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:25,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:25,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:25,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:25,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,617 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:25,617 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:25,618 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:25,621 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:25,622 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:25,622 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:25,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:25,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:25,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:25,630 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:25,630 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:25,630 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:25,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:25,630 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:25,630 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:25,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:25,631 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:25,631 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:25,630 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:25,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:25,632 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:25,632 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:25,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:25,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:25,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:25,632 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:25,632 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:25,632 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:25,632 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:25,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:25,633 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:25,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:25,633 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:25,633 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,633 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,633 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:07:25,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:25,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:25,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:25,636 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 because node does not exist (not an error) 2023-07-23 23:07:25,673 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 23:07:25,732 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,781 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:07:25,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-23 23:07:25,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-23 23:07:25,783 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 23:07:25,858 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-23 23:07:25,859 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,859 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:25,859 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1690153645474Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690153645634 (+160 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690153645634Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690153645647 (+13 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690153645684 (+37 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1690153645858 (+174 ms) 2023-07-23 23:07:25,864 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-23 23:07:25,866 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 385 msec 2023-07-23 23:07:26,083 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:07:26,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-23 23:07:26,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 23:07:26,085 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153646085 2023-07-23 23:07:26,085 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40459, tgtDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153646085, rawTgtDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153646085, srcFsUri=hdfs://localhost:40459, srcDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f 2023-07-23 23:07:26,118 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40459, inputRoot=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f 2023-07-23 23:07:26,119 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_375791294_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153646085, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153646085/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:26,119 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40459, inputRoot=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f, snapshotDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-23 23:07:26,138 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153646085/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:26,227 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:26,227 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:26,227 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:26,228 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:27,535 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/hadoop-1962967952714225288.jar 2023-07-23 23:07:27,536 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:27,537 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:27,633 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/hadoop-8960291404260562780.jar 2023-07-23 23:07:27,634 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:27,635 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:27,635 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:27,636 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:27,637 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:27,637 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:27,638 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 23:07:27,638 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 23:07:27,639 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 23:07:27,640 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 23:07:27,640 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 23:07:27,641 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 23:07:27,641 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 23:07:27,642 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 23:07:27,642 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 23:07:27,643 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 23:07:27,644 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:07:27,644 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:07:27,645 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 23:07:27,646 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:07:27,646 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:07:27,647 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 23:07:27,647 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 23:07:29,489 WARN [Listener at jenkins-hbase4.apache.org/42491] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 23:07:29,492 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-23 23:07:29,494 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-23 23:07:29,575 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 23:07:29,575 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 23:07:29,605 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0005_000001 (auth:SIMPLE) 2023-07-23 23:07:35,391 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0005_000001 (auth:SIMPLE) 2023-07-23 23:07:37,725 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0005_000001 (auth:SIMPLE) 2023-07-23 23:07:42,742 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 23:07:42,748 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 23:07:42,756 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:42,757 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 23:07:42,757 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 23:07:42,757 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2080736097_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:42,758 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-23 23:07:42,758 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-23 23:07:42,758 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2080736097_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153646085/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153646085/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:42,758 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153646085/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-23 23:07:42,758 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153646085/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-23 23:07:42,770 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:42,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:42,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:42,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-23 23:07:42,780 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153662780"}]},"ts":"1690153662780"} 2023-07-23 23:07:42,782 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-23 23:07:42,783 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-23 23:07:42,784 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8e7bcbf313fb0bb90bdb146b9740eb22, UNASSIGN}] 2023-07-23 23:07:42,787 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8e7bcbf313fb0bb90bdb146b9740eb22, UNASSIGN 2023-07-23 23:07:42,788 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=8e7bcbf313fb0bb90bdb146b9740eb22, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:42,788 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643530.8e7bcbf313fb0bb90bdb146b9740eb22.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690153662788"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153662788"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153662788"}]},"ts":"1690153662788"} 2023-07-23 23:07:42,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 8e7bcbf313fb0bb90bdb146b9740eb22, server=jenkins-hbase4.apache.org,39259,1690153558742}] 2023-07-23 23:07:42,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-23 23:07:42,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8e7bcbf313fb0bb90bdb146b9740eb22 2023-07-23 23:07:42,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8e7bcbf313fb0bb90bdb146b9740eb22, disabling compactions & flushes 2023-07-23 23:07:42,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643530.8e7bcbf313fb0bb90bdb146b9740eb22. 2023-07-23 23:07:42,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643530.8e7bcbf313fb0bb90bdb146b9740eb22. 2023-07-23 23:07:42,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643530.8e7bcbf313fb0bb90bdb146b9740eb22. after waiting 0 ms 2023-07-23 23:07:42,942 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643530.8e7bcbf313fb0bb90bdb146b9740eb22. 2023-07-23 23:07:42,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8e7bcbf313fb0bb90bdb146b9740eb22/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-23 23:07:42,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:07:42,971 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643530.8e7bcbf313fb0bb90bdb146b9740eb22. 2023-07-23 23:07:42,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8e7bcbf313fb0bb90bdb146b9740eb22: 2023-07-23 23:07:42,973 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8e7bcbf313fb0bb90bdb146b9740eb22 2023-07-23 23:07:42,974 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=8e7bcbf313fb0bb90bdb146b9740eb22, regionState=CLOSED 2023-07-23 23:07:42,974 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643530.8e7bcbf313fb0bb90bdb146b9740eb22.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690153662974"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153662974"}]},"ts":"1690153662974"} 2023-07-23 23:07:42,979 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-23 23:07:42,979 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 8e7bcbf313fb0bb90bdb146b9740eb22, server=jenkins-hbase4.apache.org,39259,1690153558742 in 187 msec 2023-07-23 23:07:42,983 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-23 23:07:42,983 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=8e7bcbf313fb0bb90bdb146b9740eb22, UNASSIGN in 195 msec 2023-07-23 23:07:42,989 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153662989"}]},"ts":"1690153662989"} 2023-07-23 23:07:42,990 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-23 23:07:42,992 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-23 23:07:42,994 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 222 msec 2023-07-23 23:07:43,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-23 23:07:43,080 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-23 23:07:43,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:43,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:43,086 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:43,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:43,087 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:43,091 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34863] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:43,094 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/acd9bf1507d94b90512cc1e9c3cdbfbf 2023-07-23 23:07:43,094 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a0739458bf8192107b3d997db8651b6 2023-07-23 23:07:43,094 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8e7bcbf313fb0bb90bdb146b9740eb22 2023-07-23 23:07:43,095 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:43,096 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:43,096 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:43,096 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:43,096 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 23:07:43,096 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 23:07:43,096 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 23:07:43,097 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-23 23:07:43,097 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8e7bcbf313fb0bb90bdb146b9740eb22/cf, FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8e7bcbf313fb0bb90bdb146b9740eb22/recovered.edits] 2023-07-23 23:07:43,096 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/acd9bf1507d94b90512cc1e9c3cdbfbf/cf, FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/acd9bf1507d94b90512cc1e9c3cdbfbf/recovered.edits] 2023-07-23 23:07:43,097 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a0739458bf8192107b3d997db8651b6/cf, FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a0739458bf8192107b3d997db8651b6/recovered.edits] 2023-07-23 23:07:43,098 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:43,098 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:43,098 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:43,098 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:43,098 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:43,098 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:43,098 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:43,098 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:43,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-23 23:07:43,099 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 23:07:43,100 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 23:07:43,100 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 23:07:43,102 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-23 23:07:43,104 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a0739458bf8192107b3d997db8651b6/cf/1f738c379d6745e695d111cc89863398 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a0739458bf8192107b3d997db8651b6/cf/1f738c379d6745e695d111cc89863398 2023-07-23 23:07:43,104 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/acd9bf1507d94b90512cc1e9c3cdbfbf/cf/a6a8022ab9644443b19c1ddb2eabad4e to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/acd9bf1507d94b90512cc1e9c3cdbfbf/cf/a6a8022ab9644443b19c1ddb2eabad4e 2023-07-23 23:07:43,104 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8e7bcbf313fb0bb90bdb146b9740eb22/cf/1f738c379d6745e695d111cc89863398.7a0739458bf8192107b3d997db8651b6 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8e7bcbf313fb0bb90bdb146b9740eb22/cf/1f738c379d6745e695d111cc89863398.7a0739458bf8192107b3d997db8651b6 2023-07-23 23:07:43,108 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8e7bcbf313fb0bb90bdb146b9740eb22/cf/a6a8022ab9644443b19c1ddb2eabad4e.acd9bf1507d94b90512cc1e9c3cdbfbf to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8e7bcbf313fb0bb90bdb146b9740eb22/cf/a6a8022ab9644443b19c1ddb2eabad4e.acd9bf1507d94b90512cc1e9c3cdbfbf 2023-07-23 23:07:43,109 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/acd9bf1507d94b90512cc1e9c3cdbfbf/recovered.edits/8.seqid to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/acd9bf1507d94b90512cc1e9c3cdbfbf/recovered.edits/8.seqid 2023-07-23 23:07:43,110 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/acd9bf1507d94b90512cc1e9c3cdbfbf 2023-07-23 23:07:43,110 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a0739458bf8192107b3d997db8651b6/recovered.edits/8.seqid to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a0739458bf8192107b3d997db8651b6/recovered.edits/8.seqid 2023-07-23 23:07:43,110 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7a0739458bf8192107b3d997db8651b6 2023-07-23 23:07:43,112 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8e7bcbf313fb0bb90bdb146b9740eb22/recovered.edits/12.seqid to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8e7bcbf313fb0bb90bdb146b9740eb22/recovered.edits/12.seqid 2023-07-23 23:07:43,113 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/8e7bcbf313fb0bb90bdb146b9740eb22 2023-07-23 23:07:43,113 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-23 23:07:43,116 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:43,119 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-23 23:07:43,120 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-23 23:07:43,122 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:43,122 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-23 23:07:43,122 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643530.8e7bcbf313fb0bb90bdb146b9740eb22.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690153663122"}]},"ts":"9223372036854775807"} 2023-07-23 23:07:43,124 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-23 23:07:43,124 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8e7bcbf313fb0bb90bdb146b9740eb22, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690153643530.8e7bcbf313fb0bb90bdb146b9740eb22.', STARTKEY => '', ENDKEY => ''}] 2023-07-23 23:07:43,124 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-23 23:07:43,124 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690153663124"}]},"ts":"9223372036854775807"} 2023-07-23 23:07:43,125 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-23 23:07:43,127 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:43,129 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 46 msec 2023-07-23 23:07:43,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-23 23:07:43,200 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-23 23:07:43,201 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:43,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:43,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:43,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-23 23:07:43,206 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153663206"}]},"ts":"1690153663206"} 2023-07-23 23:07:43,208 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-23 23:07:43,210 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-23 23:07:43,211 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e55640b856f8ffb8c42b40d8dc5afc3b, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=09386da05024281c176c399194de0545, UNASSIGN}] 2023-07-23 23:07:43,213 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e55640b856f8ffb8c42b40d8dc5afc3b, UNASSIGN 2023-07-23 23:07:43,213 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=09386da05024281c176c399194de0545, UNASSIGN 2023-07-23 23:07:43,213 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=e55640b856f8ffb8c42b40d8dc5afc3b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:43,213 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=09386da05024281c176c399194de0545, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:43,214 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690153663213"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153663213"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153663213"}]},"ts":"1690153663213"} 2023-07-23 23:07:43,214 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690153663213"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153663213"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153663213"}]},"ts":"1690153663213"} 2023-07-23 23:07:43,215 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 09386da05024281c176c399194de0545, server=jenkins-hbase4.apache.org,38881,1690153558819}] 2023-07-23 23:07:43,216 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure e55640b856f8ffb8c42b40d8dc5afc3b, server=jenkins-hbase4.apache.org,34863,1690153558866}] 2023-07-23 23:07:43,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-23 23:07:43,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 09386da05024281c176c399194de0545 2023-07-23 23:07:43,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 09386da05024281c176c399194de0545, disabling compactions & flushes 2023-07-23 23:07:43,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545. 2023-07-23 23:07:43,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545. 2023-07-23 23:07:43,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545. after waiting 0 ms 2023-07-23 23:07:43,367 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545. 2023-07-23 23:07:43,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e55640b856f8ffb8c42b40d8dc5afc3b 2023-07-23 23:07:43,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e55640b856f8ffb8c42b40d8dc5afc3b, disabling compactions & flushes 2023-07-23 23:07:43,372 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b. 2023-07-23 23:07:43,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b. 2023-07-23 23:07:43,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b. after waiting 0 ms 2023-07-23 23:07:43,372 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b. 2023-07-23 23:07:43,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion/09386da05024281c176c399194de0545/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 23:07:43,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:07:43,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545. 2023-07-23 23:07:43,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 09386da05024281c176c399194de0545: 2023-07-23 23:07:43,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithMergeRegion/e55640b856f8ffb8c42b40d8dc5afc3b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 23:07:43,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:07:43,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b. 2023-07-23 23:07:43,384 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e55640b856f8ffb8c42b40d8dc5afc3b: 2023-07-23 23:07:43,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 09386da05024281c176c399194de0545 2023-07-23 23:07:43,385 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=09386da05024281c176c399194de0545, regionState=CLOSED 2023-07-23 23:07:43,385 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690153663385"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153663385"}]},"ts":"1690153663385"} 2023-07-23 23:07:43,385 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e55640b856f8ffb8c42b40d8dc5afc3b 2023-07-23 23:07:43,385 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=e55640b856f8ffb8c42b40d8dc5afc3b, regionState=CLOSED 2023-07-23 23:07:43,385 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690153663385"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153663385"}]},"ts":"1690153663385"} 2023-07-23 23:07:43,390 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-23 23:07:43,390 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-23 23:07:43,390 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 09386da05024281c176c399194de0545, server=jenkins-hbase4.apache.org,38881,1690153558819 in 171 msec 2023-07-23 23:07:43,390 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure e55640b856f8ffb8c42b40d8dc5afc3b, server=jenkins-hbase4.apache.org,34863,1690153558866 in 171 msec 2023-07-23 23:07:43,392 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=e55640b856f8ffb8c42b40d8dc5afc3b, UNASSIGN in 179 msec 2023-07-23 23:07:43,392 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-23 23:07:43,392 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=09386da05024281c176c399194de0545, UNASSIGN in 179 msec 2023-07-23 23:07:43,393 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153663393"}]},"ts":"1690153663393"} 2023-07-23 23:07:43,394 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-23 23:07:43,396 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-23 23:07:43,400 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 196 msec 2023-07-23 23:07:43,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-23 23:07:43,509 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-23 23:07:43,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:43,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:43,518 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:43,519 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:43,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:43,521 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34863] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:43,524 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:43,524 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/09386da05024281c176c399194de0545 2023-07-23 23:07:43,524 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:43,524 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:43,524 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e55640b856f8ffb8c42b40d8dc5afc3b 2023-07-23 23:07:43,524 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:43,525 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-23 23:07:43,527 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-23 23:07:43,527 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-23 23:07:43,527 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-23 23:07:43,528 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:43,528 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:43,528 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:43,529 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:43,528 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:43,529 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:43,529 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:43,529 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:43,532 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/09386da05024281c176c399194de0545/cf, FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/09386da05024281c176c399194de0545/recovered.edits] 2023-07-23 23:07:43,532 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e55640b856f8ffb8c42b40d8dc5afc3b/cf, FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e55640b856f8ffb8c42b40d8dc5afc3b/recovered.edits] 2023-07-23 23:07:43,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-23 23:07:43,539 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/09386da05024281c176c399194de0545/cf/4807ebb916454b1fa96612d16975b6c5 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/09386da05024281c176c399194de0545/cf/4807ebb916454b1fa96612d16975b6c5 2023-07-23 23:07:43,541 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e55640b856f8ffb8c42b40d8dc5afc3b/cf/615194f95b6d48cab858d09e78dc60c3 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/e55640b856f8ffb8c42b40d8dc5afc3b/cf/615194f95b6d48cab858d09e78dc60c3 2023-07-23 23:07:43,544 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/09386da05024281c176c399194de0545/recovered.edits/9.seqid to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/09386da05024281c176c399194de0545/recovered.edits/9.seqid 2023-07-23 23:07:43,545 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/09386da05024281c176c399194de0545 2023-07-23 23:07:43,547 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e55640b856f8ffb8c42b40d8dc5afc3b/recovered.edits/9.seqid to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/e55640b856f8ffb8c42b40d8dc5afc3b/recovered.edits/9.seqid 2023-07-23 23:07:43,547 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/e55640b856f8ffb8c42b40d8dc5afc3b 2023-07-23 23:07:43,548 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-23 23:07:43,548 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-23 23:07:43,549 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-23 23:07:43,553 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230723037492cfb1484b088074f8bfef9fc7c6 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230723037492cfb1484b088074f8bfef9fc7c6 2023-07-23 23:07:43,554 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230723162e5a81f5ff43e8a80082cb208f4ff4 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230723162e5a81f5ff43e8a80082cb208f4ff4 2023-07-23 23:07:43,555 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-23 23:07:43,557 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:43,559 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-23 23:07:43,562 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-23 23:07:43,563 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:43,563 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-23 23:07:43,564 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690153663564"}]},"ts":"9223372036854775807"} 2023-07-23 23:07:43,564 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690153663564"}]},"ts":"9223372036854775807"} 2023-07-23 23:07:43,566 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 23:07:43,566 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => e55640b856f8ffb8c42b40d8dc5afc3b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690153640386.e55640b856f8ffb8c42b40d8dc5afc3b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 09386da05024281c176c399194de0545, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690153640386.09386da05024281c176c399194de0545.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 23:07:43,567 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-23 23:07:43,567 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690153663567"}]},"ts":"9223372036854775807"} 2023-07-23 23:07:43,569 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-23 23:07:43,570 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:43,572 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 60 msec 2023-07-23 23:07:43,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-23 23:07:43,633 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-23 23:07:43,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-23 23:07:43,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:43,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-23 23:07:43,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-23 23:07:43,657 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-23 23:07:43,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-23 23:07:43,699 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=759 (was 747) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:40843 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1118617868_1 at /127.0.0.1:51208 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5c344f42-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2080736097_17 at /127.0.0.1:33334 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5c344f42-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5c344f42-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4107 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2080736097_17 at /127.0.0.1:33350 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2080736097_17 at /127.0.0.1:51234 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2080736097_17 at /127.0.0.1:52314 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5c344f42-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5c344f42-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5c344f42-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=903 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=500 (was 333) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 177) - ProcessCount LEAK? -, AvailableMemoryMB=5574 (was 6196) 2023-07-23 23:07:43,700 WARN [Listener at jenkins-hbase4.apache.org/42491] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-23 23:07:43,728 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=759, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=500, ProcessCount=179, AvailableMemoryMB=5571 2023-07-23 23:07:43,728 WARN [Listener at jenkins-hbase4.apache.org/42491] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-23 23:07:43,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-23 23:07:43,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 23:07:43,738 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 23:07:43,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-23 23:07:43,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 23:07:43,739 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 23:07:43,742 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe6400750e04cf9f8be0af4445759d29 2023-07-23 23:07:43,742 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testEmptyExportFileSystemState/5a2de53587190ecebeb32cae388d2fa6 2023-07-23 23:07:43,743 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe6400750e04cf9f8be0af4445759d29 empty. 2023-07-23 23:07:43,743 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testEmptyExportFileSystemState/5a2de53587190ecebeb32cae388d2fa6 empty. 2023-07-23 23:07:43,743 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe6400750e04cf9f8be0af4445759d29 2023-07-23 23:07:43,744 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testEmptyExportFileSystemState/5a2de53587190ecebeb32cae388d2fa6 2023-07-23 23:07:43,744 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-23 23:07:43,775 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-23 23:07:43,777 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => fe6400750e04cf9f8be0af4445759d29, NAME => 'testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp 2023-07-23 23:07:43,778 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5a2de53587190ecebeb32cae388d2fa6, NAME => 'testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp 2023-07-23 23:07:43,832 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:07:43,832 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing fe6400750e04cf9f8be0af4445759d29, disabling compactions & flushes 2023-07-23 23:07:43,832 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29. 2023-07-23 23:07:43,832 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29. 2023-07-23 23:07:43,832 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29. after waiting 0 ms 2023-07-23 23:07:43,832 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29. 2023-07-23 23:07:43,832 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29. 2023-07-23 23:07:43,832 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for fe6400750e04cf9f8be0af4445759d29: 2023-07-23 23:07:43,834 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:07:43,834 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 5a2de53587190ecebeb32cae388d2fa6, disabling compactions & flushes 2023-07-23 23:07:43,834 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6. 2023-07-23 23:07:43,834 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6. 2023-07-23 23:07:43,834 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6. after waiting 0 ms 2023-07-23 23:07:43,834 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6. 2023-07-23 23:07:43,834 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6. 2023-07-23 23:07:43,834 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 5a2de53587190ecebeb32cae388d2fa6: 2023-07-23 23:07:43,837 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 23:07:43,839 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690153663839"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153663839"}]},"ts":"1690153663839"} 2023-07-23 23:07:43,839 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690153663839"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153663839"}]},"ts":"1690153663839"} 2023-07-23 23:07:43,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 23:07:43,843 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 23:07:43,844 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 23:07:43,844 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153663844"}]},"ts":"1690153663844"} 2023-07-23 23:07:43,846 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-23 23:07:43,851 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 23:07:43,853 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 23:07:43,853 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 23:07:43,853 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 23:07:43,853 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 23:07:43,853 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fe6400750e04cf9f8be0af4445759d29, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5a2de53587190ecebeb32cae388d2fa6, ASSIGN}] 2023-07-23 23:07:43,858 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5a2de53587190ecebeb32cae388d2fa6, ASSIGN 2023-07-23 23:07:43,858 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fe6400750e04cf9f8be0af4445759d29, ASSIGN 2023-07-23 23:07:43,859 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5a2de53587190ecebeb32cae388d2fa6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34863,1690153558866; forceNewPlan=false, retain=false 2023-07-23 23:07:43,862 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fe6400750e04cf9f8be0af4445759d29, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39259,1690153558742; forceNewPlan=false, retain=false 2023-07-23 23:07:44,009 INFO [jenkins-hbase4:43049] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 23:07:44,012 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=fe6400750e04cf9f8be0af4445759d29, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,012 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=5a2de53587190ecebeb32cae388d2fa6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,012 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690153664012"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153664012"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153664012"}]},"ts":"1690153664012"} 2023-07-23 23:07:44,013 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690153664012"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153664012"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153664012"}]},"ts":"1690153664012"} 2023-07-23 23:07:44,014 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure fe6400750e04cf9f8be0af4445759d29, server=jenkins-hbase4.apache.org,39259,1690153558742}] 2023-07-23 23:07:44,016 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 5a2de53587190ecebeb32cae388d2fa6, server=jenkins-hbase4.apache.org,34863,1690153558866}] 2023-07-23 23:07:44,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 23:07:44,176 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6. 2023-07-23 23:07:44,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5a2de53587190ecebeb32cae388d2fa6, NAME => 'testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 23:07:44,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6. service=AccessControlService 2023-07-23 23:07:44,177 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 23:07:44,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 5a2de53587190ecebeb32cae388d2fa6 2023-07-23 23:07:44,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:07:44,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5a2de53587190ecebeb32cae388d2fa6 2023-07-23 23:07:44,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5a2de53587190ecebeb32cae388d2fa6 2023-07-23 23:07:44,178 INFO [StoreOpener-5a2de53587190ecebeb32cae388d2fa6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5a2de53587190ecebeb32cae388d2fa6 2023-07-23 23:07:44,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29. 2023-07-23 23:07:44,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fe6400750e04cf9f8be0af4445759d29, NAME => 'testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 23:07:44,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29. service=AccessControlService 2023-07-23 23:07:44,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 23:07:44,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState fe6400750e04cf9f8be0af4445759d29 2023-07-23 23:07:44,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:07:44,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fe6400750e04cf9f8be0af4445759d29 2023-07-23 23:07:44,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fe6400750e04cf9f8be0af4445759d29 2023-07-23 23:07:44,181 INFO [StoreOpener-fe6400750e04cf9f8be0af4445759d29-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fe6400750e04cf9f8be0af4445759d29 2023-07-23 23:07:44,183 DEBUG [StoreOpener-fe6400750e04cf9f8be0af4445759d29-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testEmptyExportFileSystemState/fe6400750e04cf9f8be0af4445759d29/cf 2023-07-23 23:07:44,183 DEBUG [StoreOpener-fe6400750e04cf9f8be0af4445759d29-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testEmptyExportFileSystemState/fe6400750e04cf9f8be0af4445759d29/cf 2023-07-23 23:07:44,183 INFO [StoreOpener-fe6400750e04cf9f8be0af4445759d29-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe6400750e04cf9f8be0af4445759d29 columnFamilyName cf 2023-07-23 23:07:44,183 DEBUG [StoreOpener-5a2de53587190ecebeb32cae388d2fa6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testEmptyExportFileSystemState/5a2de53587190ecebeb32cae388d2fa6/cf 2023-07-23 23:07:44,183 DEBUG [StoreOpener-5a2de53587190ecebeb32cae388d2fa6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testEmptyExportFileSystemState/5a2de53587190ecebeb32cae388d2fa6/cf 2023-07-23 23:07:44,184 INFO [StoreOpener-5a2de53587190ecebeb32cae388d2fa6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5a2de53587190ecebeb32cae388d2fa6 columnFamilyName cf 2023-07-23 23:07:44,185 INFO [StoreOpener-5a2de53587190ecebeb32cae388d2fa6-1] regionserver.HStore(310): Store=5a2de53587190ecebeb32cae388d2fa6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 23:07:44,185 INFO [StoreOpener-fe6400750e04cf9f8be0af4445759d29-1] regionserver.HStore(310): Store=fe6400750e04cf9f8be0af4445759d29/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 23:07:44,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testEmptyExportFileSystemState/5a2de53587190ecebeb32cae388d2fa6 2023-07-23 23:07:44,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testEmptyExportFileSystemState/5a2de53587190ecebeb32cae388d2fa6 2023-07-23 23:07:44,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testEmptyExportFileSystemState/fe6400750e04cf9f8be0af4445759d29 2023-07-23 23:07:44,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testEmptyExportFileSystemState/fe6400750e04cf9f8be0af4445759d29 2023-07-23 23:07:44,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fe6400750e04cf9f8be0af4445759d29 2023-07-23 23:07:44,192 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5a2de53587190ecebeb32cae388d2fa6 2023-07-23 23:07:44,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testEmptyExportFileSystemState/5a2de53587190ecebeb32cae388d2fa6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 23:07:44,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testEmptyExportFileSystemState/fe6400750e04cf9f8be0af4445759d29/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 23:07:44,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5a2de53587190ecebeb32cae388d2fa6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64959551, jitterRate=-0.03202725946903229}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 23:07:44,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5a2de53587190ecebeb32cae388d2fa6: 2023-07-23 23:07:44,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fe6400750e04cf9f8be0af4445759d29; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70805389, jitterRate=0.05508251488208771}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 23:07:44,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fe6400750e04cf9f8be0af4445759d29: 2023-07-23 23:07:44,196 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6., pid=94, masterSystemTime=1690153664172 2023-07-23 23:07:44,196 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29., pid=93, masterSystemTime=1690153664172 2023-07-23 23:07:44,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6. 2023-07-23 23:07:44,197 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6. 2023-07-23 23:07:44,198 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=5a2de53587190ecebeb32cae388d2fa6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,198 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690153664198"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690153664198"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690153664198"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690153664198"}]},"ts":"1690153664198"} 2023-07-23 23:07:44,203 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29. 2023-07-23 23:07:44,203 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29. 2023-07-23 23:07:44,203 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=fe6400750e04cf9f8be0af4445759d29, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,203 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690153664203"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690153664203"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690153664203"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690153664203"}]},"ts":"1690153664203"} 2023-07-23 23:07:44,211 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-23 23:07:44,211 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 5a2de53587190ecebeb32cae388d2fa6, server=jenkins-hbase4.apache.org,34863,1690153558866 in 188 msec 2023-07-23 23:07:44,213 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5a2de53587190ecebeb32cae388d2fa6, ASSIGN in 358 msec 2023-07-23 23:07:44,215 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-23 23:07:44,215 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure fe6400750e04cf9f8be0af4445759d29, server=jenkins-hbase4.apache.org,39259,1690153558742 in 199 msec 2023-07-23 23:07:44,217 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-23 23:07:44,217 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fe6400750e04cf9f8be0af4445759d29, ASSIGN in 362 msec 2023-07-23 23:07:44,218 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 23:07:44,218 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153664218"}]},"ts":"1690153664218"} 2023-07-23 23:07:44,221 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-23 23:07:44,224 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 23:07:44,225 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-23 23:07:44,227 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34863] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 23:07:44,230 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:44,230 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:44,230 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:44,230 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:44,232 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 23:07:44,232 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 23:07:44,232 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 23:07:44,233 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 23:07:44,233 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 23:07:44,234 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-23 23:07:44,235 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 502 msec 2023-07-23 23:07:44,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-23 23:07:44,348 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-23 23:07:44,350 DEBUG [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-23 23:07:44,351 DEBUG [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29. 2023-07-23 23:07:44,353 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 23:07:44,395 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 23:07:44,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690153664395 (current time:1690153664395). 2023-07-23 23:07:44,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 23:07:44,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(139): Connect 0x13a50883 to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:07:44,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ef5e317, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:07:44,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:07:44,425 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55194, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:07:44,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13a50883 to 127.0.0.1:58893 2023-07-23 23:07:44,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:07:44,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(139): Connect 0x0293fbd5 to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:07:44,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39491a14, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:07:44,447 DEBUG [hconnection-0x6875bb71-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:07:44,452 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55208, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:07:44,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:07:44,460 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40756, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:07:44,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0293fbd5 to 127.0.0.1:58893 2023-07-23 23:07:44,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:07:44,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 23:07:44,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 23:07:44,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 23:07:44,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 23:07:44,467 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 23:07:44,468 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690154264468 2023-07-23 23:07:44,468 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-23 23:07:44,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 23:07:44,470 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 23:07:44,470 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 23:07:44,471 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 23:07:44,472 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 23:07:44,474 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-23 23:07:44,487 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 23:07:44,489 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690154264489 2023-07-23 23:07:44,561 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,561 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-23 23:07:44,561 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:07:44,563 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-23 23:07:44,563 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-23 23:07:44,564 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,564 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,570 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:07:44,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 23:07:44,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 23:07:44,572 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 23:07:44,572 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:44,572 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:44,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:44,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:44,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:44,572 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:44,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:44,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:44,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:44,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-23 23:07:44,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-23 23:07:44,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,574 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 23:07:44,574 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,574 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 23:07:44,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-23 23:07:44,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,575 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 23:07:44,575 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,575 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,575 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,575 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 23:07:44,578 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,579 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,579 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 23:07:44,579 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 23:07:44,579 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:07:44,579 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:07:44,581 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 23:07:44,582 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 23:07:44,582 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 23:07:44,579 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,582 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34863,1690153558866' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 23:07:44,582 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 23:07:44,582 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:07:44,582 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 23:07:44,583 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 23:07:44,583 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 23:07:44,583 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1690153558819' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 23:07:44,583 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39259,1690153558742' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 23:07:44,587 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,587 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:44,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:44,588 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,588 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,588 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,588 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,588 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:07:44,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:44,588 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,588 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:07:44,588 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,589 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:07:44,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:44,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:44,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:44,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34863,1690153558866' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 23:07:44,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13b2bca6[Count = 1] remaining members to acquire global barrier 2023-07-23 23:07:44,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:44,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:44,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:44,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:44,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:44,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:44,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39259,1690153558742' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 23:07:44,594 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13b2bca6[Count = 0] remaining members to acquire global barrier 2023-07-23 23:07:44,594 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 23:07:44,594 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,596 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,596 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,596 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,596 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 23:07:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,596 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 23:07:44,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,596 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 23:07:44,596 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,596 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 23:07:44,596 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 23:07:44,596 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 23:07:44,596 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38881,1690153558819' in zk 2023-07-23 23:07:44,597 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29. 2023-07-23 23:07:44,597 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29. started... 2023-07-23 23:07:44,597 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,597 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 23:07:44,597 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fe6400750e04cf9f8be0af4445759d29: 2023-07-23 23:07:44,597 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,598 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 23:07:44,598 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 23:07:44,598 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 23:07:44,598 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:07:44,598 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 23:07:44,602 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 23:07:44,602 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 23:07:44,602 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6. 2023-07-23 23:07:44,604 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6. started... 2023-07-23 23:07:44,606 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5a2de53587190ecebeb32cae388d2fa6: 2023-07-23 23:07:44,606 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,606 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 23:07:44,606 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 23:07:44,639 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29. completed. 2023-07-23 23:07:44,639 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29. 2023-07-23 23:07:44,639 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 23:07:44,642 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 23:07:44,642 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,642 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 23:07:44,642 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39259,1690153558742' in zk 2023-07-23 23:07:44,644 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6. completed. 2023-07-23 23:07:44,644 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 23:07:44,644 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6. 2023-07-23 23:07:44,644 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,644 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 23:07:44,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:44,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:44,644 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:07:44,644 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 23:07:44,644 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 23:07:44,645 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,645 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 23:07:44,646 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34863,1690153558866' in zk 2023-07-23 23:07:44,649 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:44,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:44,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:44,651 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 23:07:44,651 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:07:44,651 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 23:07:44,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:44,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:44,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39259,1690153558742': 2023-07-23 23:07:44,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39259,1690153558742' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 23:07:44,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:44,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:44,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:44,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:44,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:44,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:44,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:44,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34863,1690153558866': 2023-07-23 23:07:44,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34863,1690153558866' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 23:07:44,659 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-23 23:07:44,659 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 23:07:44,659 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 23:07:44,659 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,659 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 23:07:44,661 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,661 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:44,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,661 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,661 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,661 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:44,661 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:44,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:44,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,661 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,661 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:44,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:44,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:44,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:44,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:44,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:44,662 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:44,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:44,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:44,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:44,663 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:44,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,665 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:44,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:44,665 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,666 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:44,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,669 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:44,669 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:44,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:44,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:44,669 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:44,669 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:44,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:44,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:44,669 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:44,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:44,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:44,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:44,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:44,670 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:44,670 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:44,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:44,670 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:44,670 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:44,670 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,670 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:07:44,670 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-23 23:07:44,670 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:44,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 23:07:44,672 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,673 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,673 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,673 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,673 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:44,673 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,673 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,673 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-23 23:07:44,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,687 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,759 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-23 23:07:44,759 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,759 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,759 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690153664468Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1690153664686 (+218 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690153664686Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1690153664686Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1690153664690 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690153664707 (+17 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690153664759 (+52 ms) 2023-07-23 23:07:44,764 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 23:07:44,765 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 294 msec 2023-07-23 23:07:44,772 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:07:44,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 23:07:44,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 23:07:44,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39259] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 23:07:44,777 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34863] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 23:07:44,781 DEBUG [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-23 23:07:44,782 DEBUG [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29. 2023-07-23 23:07:44,782 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 23:07:44,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 23:07:44,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690153664792 (current time:1690153664792). 2023-07-23 23:07:44,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 23:07:44,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(139): Connect 0x41a7006b to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:07:44,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4cc851d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:07:44,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:07:44,809 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55218, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:07:44,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x41a7006b to 127.0.0.1:58893 2023-07-23 23:07:44,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:07:44,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(139): Connect 0x19d8a50c to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:07:44,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60854a04, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:07:44,820 DEBUG [hconnection-0x1cf64-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:07:44,821 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55220, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:07:44,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:07:44,830 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40766, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:07:44,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19d8a50c to 127.0.0.1:58893 2023-07-23 23:07:44,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:07:44,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-23 23:07:44,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 23:07:44,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 23:07:44,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 23:07:44,836 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 23:07:44,837 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690154264837 2023-07-23 23:07:44,837 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-23 23:07:44,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-23 23:07:44,838 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 23:07:44,838 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 23:07:44,840 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-23 23:07:44,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 23:07:44,841 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-23 23:07:44,842 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 23:07:44,843 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690154264843 2023-07-23 23:07:44,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,866 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-23 23:07:44,866 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:07:44,868 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-23 23:07:44,868 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-23 23:07:44,868 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,868 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,870 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:44,870 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:44,870 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:44,870 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:44,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:44,870 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:44,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:44,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:44,870 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,870 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:44,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,871 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,871 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 23:07:44,871 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,871 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,871 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-23 23:07:44,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-23 23:07:44,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,872 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 23:07:44,872 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 23:07:44,872 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-23 23:07:44,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,872 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 23:07:44,872 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:07:44,872 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-23 23:07:44,876 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,876 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 23:07:44,876 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:07:44,880 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,882 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 23:07:44,882 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-23 23:07:44,882 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:07:44,882 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 23:07:44,882 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 23:07:44,886 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-23 23:07:44,886 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 23:07:44,882 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-23 23:07:44,886 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34863,1690153558866' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 23:07:44,886 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39259,1690153558742' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 23:07:44,886 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1690153558819' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-23 23:07:44,889 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,889 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,889 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,889 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,890 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:07:44,889 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,890 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,890 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:07:44,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:44,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:44,891 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,891 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,891 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:07:44,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:44,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:44,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:44,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:44,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39259,1690153558742' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 23:07:44,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60766e11[Count = 1] remaining members to acquire global barrier 2023-07-23 23:07:44,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:44,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:44,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:44,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:44,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:44,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:44,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34863,1690153558866' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-23 23:07:44,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60766e11[Count = 0] remaining members to acquire global barrier 2023-07-23 23:07:44,897 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-23 23:07:44,897 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,902 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,902 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,902 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,902 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,902 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:44,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,903 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 23:07:44,902 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 23:07:44,903 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:44,903 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 23:07:44,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,903 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-23 23:07:44,903 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 23:07:44,903 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38881,1690153558819' in zk 2023-07-23 23:07:44,905 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 23:07:44,905 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:07:44,905 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 23:07:44,908 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 23:07:44,908 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 23:07:44,908 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6. 2023-07-23 23:07:44,908 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 23:07:44,908 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6. started... 2023-07-23 23:07:44,908 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 23:07:44,908 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29. 2023-07-23 23:07:44,908 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29. started... 2023-07-23 23:07:44,908 INFO [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5a2de53587190ecebeb32cae388d2fa6 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-23 23:07:44,908 INFO [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fe6400750e04cf9f8be0af4445759d29 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-23 23:07:44,939 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:07:44,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 23:07:44,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 23:07:44,940 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 23:07:44,953 INFO [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230723584361847b6648d5958e4a4e4ac435b2 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230723584361847b6648d5958e4a4e4ac435b2 2023-07-23 23:07:44,958 INFO [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230723fad448e45de84163999c4fdacbf5395a to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230723fad448e45de84163999c4fdacbf5395a 2023-07-23 23:07:44,970 INFO [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testEmptyExportFileSystemState/5a2de53587190ecebeb32cae388d2fa6/.tmp/cf/4a06e474a36b46b4b90621f04a2555a2 2023-07-23 23:07:44,976 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testEmptyExportFileSystemState/5a2de53587190ecebeb32cae388d2fa6/.tmp/cf/4a06e474a36b46b4b90621f04a2555a2 as hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testEmptyExportFileSystemState/5a2de53587190ecebeb32cae388d2fa6/cf/4a06e474a36b46b4b90621f04a2555a2 2023-07-23 23:07:44,977 INFO [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testEmptyExportFileSystemState/fe6400750e04cf9f8be0af4445759d29/.tmp/cf/a4029e606c9648d78e5147c0c61cfaf1 2023-07-23 23:07:44,981 INFO [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testEmptyExportFileSystemState/5a2de53587190ecebeb32cae388d2fa6/cf/4a06e474a36b46b4b90621f04a2555a2, entries=48, sequenceid=6, filesize=13.2 K 2023-07-23 23:07:44,982 INFO [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 5a2de53587190ecebeb32cae388d2fa6 in 74ms, sequenceid=6, compaction requested=false 2023-07-23 23:07:44,982 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-23 23:07:44,982 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testEmptyExportFileSystemState/fe6400750e04cf9f8be0af4445759d29/.tmp/cf/a4029e606c9648d78e5147c0c61cfaf1 as hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testEmptyExportFileSystemState/fe6400750e04cf9f8be0af4445759d29/cf/a4029e606c9648d78e5147c0c61cfaf1 2023-07-23 23:07:44,983 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5a2de53587190ecebeb32cae388d2fa6: 2023-07-23 23:07:44,983 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,985 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 23:07:44,985 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testEmptyExportFileSystemState/5a2de53587190ecebeb32cae388d2fa6/cf/4a06e474a36b46b4b90621f04a2555a2] hfiles 2023-07-23 23:07:44,985 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testEmptyExportFileSystemState/5a2de53587190ecebeb32cae388d2fa6/cf/4a06e474a36b46b4b90621f04a2555a2 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,991 INFO [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testEmptyExportFileSystemState/fe6400750e04cf9f8be0af4445759d29/cf/a4029e606c9648d78e5147c0c61cfaf1, entries=2, sequenceid=6, filesize=5.2 K 2023-07-23 23:07:44,992 INFO [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for fe6400750e04cf9f8be0af4445759d29 in 84ms, sequenceid=6, compaction requested=false 2023-07-23 23:07:44,994 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fe6400750e04cf9f8be0af4445759d29: 2023-07-23 23:07:44,994 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:44,994 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 23:07:44,994 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testEmptyExportFileSystemState/fe6400750e04cf9f8be0af4445759d29/cf/a4029e606c9648d78e5147c0c61cfaf1] hfiles 2023-07-23 23:07:44,994 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testEmptyExportFileSystemState/fe6400750e04cf9f8be0af4445759d29/cf/a4029e606c9648d78e5147c0c61cfaf1 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,016 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6. completed. 2023-07-23 23:07:45,016 DEBUG [rs(jenkins-hbase4.apache.org,34863,1690153558866)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6. 2023-07-23 23:07:45,016 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 23:07:45,016 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 23:07:45,016 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:45,027 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 23:07:45,028 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34863,1690153558866' in zk 2023-07-23 23:07:45,031 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:45,031 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29. completed. 2023-07-23 23:07:45,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:45,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:45,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:45,031 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 23:07:45,031 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:07:45,031 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 23:07:45,031 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29. 2023-07-23 23:07:45,033 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 23:07:45,033 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 23:07:45,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:45,034 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:45,034 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-23 23:07:45,034 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39259,1690153558742' in zk 2023-07-23 23:07:45,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:45,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,035 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:45,036 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-23 23:07:45,036 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:07:45,036 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-23 23:07:45,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:45,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:45,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:45,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:45,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:45,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:45,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:45,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34863,1690153558866': 2023-07-23 23:07:45,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34863,1690153558866' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-23 23:07:45,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:45,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:45,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:45,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:45,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:45,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:45,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:45,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:45,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:45,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:45,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:45,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:45,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39259,1690153558742': 2023-07-23 23:07:45,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39259,1690153558742' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-23 23:07:45,063 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-23 23:07:45,063 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 23:07:45,063 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 23:07:45,063 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,063 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 23:07:45,066 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,066 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:45,066 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,066 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:45,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:45,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:45,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,066 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,067 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,067 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:45,066 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:45,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:45,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:45,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:45,068 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:45,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:45,068 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:45,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:45,069 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:45,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:45,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:45,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:45,072 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:45,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:45,072 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:45,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:45,073 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:45,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:45,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:45,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:45,076 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:45,076 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:45,077 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:45,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:45,077 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:45,077 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:45,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:45,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:45,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:45,077 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:45,077 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:07:45,077 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:45,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:45,077 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,077 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:45,077 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,077 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:07:45,077 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-23 23:07:45,077 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:45,079 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,079 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:45,079 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,079 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,079 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:45,080 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:45,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:45,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:45,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 23:07:45,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:45,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:45,080 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,080 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:07:45,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:07:45,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230723584361847b6648d5958e4a4e4ac435b2, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230723fad448e45de84163999c4fdacbf5395a] mob files 2023-07-23 23:07:45,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230723584361847b6648d5958e4a4e4ac435b2 2023-07-23 23:07:45,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230723fad448e45de84163999c4fdacbf5395a 2023-07-23 23:07:45,103 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,104 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,140 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:07:45,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 23:07:45,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-23 23:07:45,142 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 23:07:45,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,230 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-23 23:07:45,230 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,231 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,231 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690153664837Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1690153665103 (+266 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1690153665103Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1690153665103Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1690153665118 (+15 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1690153665164 (+46 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690153665230 (+66 ms) 2023-07-23 23:07:45,234 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-23 23:07:45,236 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 396 msec 2023-07-23 23:07:45,443 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:07:45,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-23 23:07:45,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 23:07:45,444 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153665444 2023-07-23 23:07:45,444 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40459, tgtDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153665444, rawTgtDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153665444, srcFsUri=hdfs://localhost:40459, srcDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f 2023-07-23 23:07:45,480 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40459, inputRoot=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f 2023-07-23 23:07:45,480 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_171467869_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153665444, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153665444/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,481 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40459, inputRoot=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f, snapshotDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-23 23:07:45,503 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153665444/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:45,609 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:45,610 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:45,610 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:45,611 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:46,830 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/hadoop-5465515182073302181.jar 2023-07-23 23:07:46,831 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:46,832 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:46,918 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/hadoop-8119861860330387948.jar 2023-07-23 23:07:46,918 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:46,919 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:46,920 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:46,920 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:46,921 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:46,921 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 23:07:46,922 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 23:07:46,922 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 23:07:46,923 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 23:07:46,923 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 23:07:46,924 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 23:07:46,925 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 23:07:46,925 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 23:07:46,926 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 23:07:46,926 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 23:07:46,927 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 23:07:46,928 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:07:46,928 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:07:46,929 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 23:07:46,930 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:07:46,930 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:07:46,931 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 23:07:46,932 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 23:07:47,650 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0005_000001 (auth:SIMPLE) 2023-07-23 23:07:47,789 WARN [DataStreamer for file /user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/hadoop/mapreduce-am-staging-root-dir/jenkins/.staging/job_1690153567960_0006/libjars/hbase-metrics-2.4.18-SNAPSHOT.jar] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-23 23:07:48,698 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 23:07:49,095 WARN [Listener at jenkins-hbase4.apache.org/42491] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 23:07:49,120 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-23 23:07:49,397 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 23:07:49,397 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 23:07:49,663 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0006_000001 (auth:SIMPLE) 2023-07-23 23:07:55,327 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0006_000001 (auth:SIMPLE) 2023-07-23 23:07:58,556 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 23:07:58,557 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 23:07:58,564 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:58,564 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 23:07:58,565 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 23:07:58,565 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2080736097_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:58,566 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-23 23:07:58,566 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-23 23:07:58,566 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2080736097_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153665444/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153665444/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:58,566 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153665444/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-23 23:07:58,566 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153665444/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-23 23:07:58,572 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-23 23:07:58,572 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-23 23:07:58,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 23:07:58,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-23 23:07:58,577 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153678577"}]},"ts":"1690153678577"} 2023-07-23 23:07:58,579 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-23 23:07:58,581 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-23 23:07:58,582 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fe6400750e04cf9f8be0af4445759d29, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5a2de53587190ecebeb32cae388d2fa6, UNASSIGN}] 2023-07-23 23:07:58,589 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fe6400750e04cf9f8be0af4445759d29, UNASSIGN 2023-07-23 23:07:58,589 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5a2de53587190ecebeb32cae388d2fa6, UNASSIGN 2023-07-23 23:07:58,590 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=5a2de53587190ecebeb32cae388d2fa6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:58,590 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=fe6400750e04cf9f8be0af4445759d29, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:58,590 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690153678590"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153678590"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153678590"}]},"ts":"1690153678590"} 2023-07-23 23:07:58,590 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690153678590"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153678590"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153678590"}]},"ts":"1690153678590"} 2023-07-23 23:07:58,592 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 5a2de53587190ecebeb32cae388d2fa6, server=jenkins-hbase4.apache.org,34863,1690153558866}] 2023-07-23 23:07:58,597 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure fe6400750e04cf9f8be0af4445759d29, server=jenkins-hbase4.apache.org,39259,1690153558742}] 2023-07-23 23:07:58,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-23 23:07:58,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5a2de53587190ecebeb32cae388d2fa6 2023-07-23 23:07:58,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5a2de53587190ecebeb32cae388d2fa6, disabling compactions & flushes 2023-07-23 23:07:58,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6. 2023-07-23 23:07:58,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6. 2023-07-23 23:07:58,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6. after waiting 0 ms 2023-07-23 23:07:58,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6. 2023-07-23 23:07:58,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fe6400750e04cf9f8be0af4445759d29 2023-07-23 23:07:58,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fe6400750e04cf9f8be0af4445759d29, disabling compactions & flushes 2023-07-23 23:07:58,753 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29. 2023-07-23 23:07:58,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29. 2023-07-23 23:07:58,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29. after waiting 0 ms 2023-07-23 23:07:58,753 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29. 2023-07-23 23:07:58,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testEmptyExportFileSystemState/fe6400750e04cf9f8be0af4445759d29/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 23:07:58,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testEmptyExportFileSystemState/5a2de53587190ecebeb32cae388d2fa6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 23:07:58,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:07:58,766 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:07:58,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6. 2023-07-23 23:07:58,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29. 2023-07-23 23:07:58,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5a2de53587190ecebeb32cae388d2fa6: 2023-07-23 23:07:58,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fe6400750e04cf9f8be0af4445759d29: 2023-07-23 23:07:58,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5a2de53587190ecebeb32cae388d2fa6 2023-07-23 23:07:58,770 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=5a2de53587190ecebeb32cae388d2fa6, regionState=CLOSED 2023-07-23 23:07:58,770 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690153678770"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153678770"}]},"ts":"1690153678770"} 2023-07-23 23:07:58,771 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=fe6400750e04cf9f8be0af4445759d29, regionState=CLOSED 2023-07-23 23:07:58,771 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690153678771"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153678771"}]},"ts":"1690153678771"} 2023-07-23 23:07:58,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fe6400750e04cf9f8be0af4445759d29 2023-07-23 23:07:58,774 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-23 23:07:58,774 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 5a2de53587190ecebeb32cae388d2fa6, server=jenkins-hbase4.apache.org,34863,1690153558866 in 180 msec 2023-07-23 23:07:58,775 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-23 23:07:58,775 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure fe6400750e04cf9f8be0af4445759d29, server=jenkins-hbase4.apache.org,39259,1690153558742 in 176 msec 2023-07-23 23:07:58,776 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5a2de53587190ecebeb32cae388d2fa6, UNASSIGN in 192 msec 2023-07-23 23:07:58,776 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-23 23:07:58,776 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fe6400750e04cf9f8be0af4445759d29, UNASSIGN in 193 msec 2023-07-23 23:07:58,777 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153678777"}]},"ts":"1690153678777"} 2023-07-23 23:07:58,778 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-23 23:07:58,780 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-23 23:07:58,782 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 209 msec 2023-07-23 23:07:58,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-23 23:07:58,880 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-23 23:07:58,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-23 23:07:58,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 23:07:58,883 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 23:07:58,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-23 23:07:58,884 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 23:07:58,885 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34863] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-23 23:07:58,888 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 23:07:58,888 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 23:07:58,888 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 23:07:58,888 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 23:07:58,888 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-23 23:07:58,888 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-23 23:07:58,888 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-23 23:07:58,889 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-23 23:07:58,890 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testEmptyExportFileSystemState/5a2de53587190ecebeb32cae388d2fa6 2023-07-23 23:07:58,890 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe6400750e04cf9f8be0af4445759d29 2023-07-23 23:07:58,891 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 23:07:58,891 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 23:07:58,891 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 23:07:58,891 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-23 23:07:58,891 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:58,891 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:58,891 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:58,891 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:58,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-23 23:07:58,892 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testEmptyExportFileSystemState/5a2de53587190ecebeb32cae388d2fa6/cf, FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testEmptyExportFileSystemState/5a2de53587190ecebeb32cae388d2fa6/recovered.edits] 2023-07-23 23:07:58,893 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe6400750e04cf9f8be0af4445759d29/cf, FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe6400750e04cf9f8be0af4445759d29/recovered.edits] 2023-07-23 23:07:58,899 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testEmptyExportFileSystemState/5a2de53587190ecebeb32cae388d2fa6/cf/4a06e474a36b46b4b90621f04a2555a2 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testEmptyExportFileSystemState/5a2de53587190ecebeb32cae388d2fa6/cf/4a06e474a36b46b4b90621f04a2555a2 2023-07-23 23:07:58,899 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe6400750e04cf9f8be0af4445759d29/cf/a4029e606c9648d78e5147c0c61cfaf1 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testEmptyExportFileSystemState/fe6400750e04cf9f8be0af4445759d29/cf/a4029e606c9648d78e5147c0c61cfaf1 2023-07-23 23:07:58,902 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testEmptyExportFileSystemState/5a2de53587190ecebeb32cae388d2fa6/recovered.edits/9.seqid to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testEmptyExportFileSystemState/5a2de53587190ecebeb32cae388d2fa6/recovered.edits/9.seqid 2023-07-23 23:07:58,903 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testEmptyExportFileSystemState/5a2de53587190ecebeb32cae388d2fa6 2023-07-23 23:07:58,903 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe6400750e04cf9f8be0af4445759d29/recovered.edits/9.seqid to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testEmptyExportFileSystemState/fe6400750e04cf9f8be0af4445759d29/recovered.edits/9.seqid 2023-07-23 23:07:58,904 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe6400750e04cf9f8be0af4445759d29 2023-07-23 23:07:58,904 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-23 23:07:58,904 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-23 23:07:58,905 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-23 23:07:58,909 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230723584361847b6648d5958e4a4e4ac435b2 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230723584361847b6648d5958e4a4e4ac435b2 2023-07-23 23:07:58,911 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230723fad448e45de84163999c4fdacbf5395a to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230723fad448e45de84163999c4fdacbf5395a 2023-07-23 23:07:58,911 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-23 23:07:58,914 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 23:07:58,916 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-23 23:07:58,918 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-23 23:07:58,919 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 23:07:58,919 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-23 23:07:58,919 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690153678919"}]},"ts":"9223372036854775807"} 2023-07-23 23:07:58,919 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690153678919"}]},"ts":"9223372036854775807"} 2023-07-23 23:07:58,921 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 23:07:58,921 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => fe6400750e04cf9f8be0af4445759d29, NAME => 'testtb-testEmptyExportFileSystemState,,1690153663730.fe6400750e04cf9f8be0af4445759d29.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5a2de53587190ecebeb32cae388d2fa6, NAME => 'testtb-testEmptyExportFileSystemState,1,1690153663730.5a2de53587190ecebeb32cae388d2fa6.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 23:07:58,921 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-23 23:07:58,921 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690153678921"}]},"ts":"9223372036854775807"} 2023-07-23 23:07:58,923 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-23 23:07:58,925 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-23 23:07:58,926 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 45 msec 2023-07-23 23:07:58,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-23 23:07:58,994 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-23 23:07:59,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-23 23:07:59,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:59,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-23 23:07:59,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-23 23:07:59,034 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=762 (was 759) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5c344f42-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5c344f42-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:33775 from appattempt_1690153567960_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-565179660_1 at /127.0.0.1:46264 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2080736097_17 at /127.0.0.1:46280 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5c344f42-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5c344f42-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-565179660_1 at /127.0.0.1:52400 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4794 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2080736097_17 at /127.0.0.1:51148 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2080736097_17 at /127.0.0.1:52442 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:35439 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=914 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=550 (was 500) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 179) - ProcessCount LEAK? -, AvailableMemoryMB=4964 (was 5571) 2023-07-23 23:07:59,034 WARN [Listener at jenkins-hbase4.apache.org/42491] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-23 23:07:59,054 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762, OpenFileDescriptor=914, MaxFileDescriptor=60000, SystemLoadAverage=550, ProcessCount=181, AvailableMemoryMB=4963 2023-07-23 23:07:59,055 WARN [Listener at jenkins-hbase4.apache.org/42491] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-23 23:07:59,056 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-23 23:07:59,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,059 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-23 23:07:59,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-23 23:07:59,060 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-23 23:07:59,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 23:07:59,062 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/dc6ced685bf46e1e18bd22a777e6a250 2023-07-23 23:07:59,062 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3570e7df4d2983406cfd49d0d2eac547 2023-07-23 23:07:59,063 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/dc6ced685bf46e1e18bd22a777e6a250 empty. 2023-07-23 23:07:59,063 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3570e7df4d2983406cfd49d0d2eac547 empty. 2023-07-23 23:07:59,063 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/dc6ced685bf46e1e18bd22a777e6a250 2023-07-23 23:07:59,063 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3570e7df4d2983406cfd49d0d2eac547 2023-07-23 23:07:59,063 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-23 23:07:59,076 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-23 23:07:59,077 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => dc6ced685bf46e1e18bd22a777e6a250, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp 2023-07-23 23:07:59,078 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3570e7df4d2983406cfd49d0d2eac547, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp 2023-07-23 23:07:59,120 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:07:59,120 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 3570e7df4d2983406cfd49d0d2eac547, disabling compactions & flushes 2023-07-23 23:07:59,120 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547. 2023-07-23 23:07:59,120 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547. 2023-07-23 23:07:59,120 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547. after waiting 0 ms 2023-07-23 23:07:59,121 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547. 2023-07-23 23:07:59,121 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547. 2023-07-23 23:07:59,121 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 3570e7df4d2983406cfd49d0d2eac547: 2023-07-23 23:07:59,123 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:07:59,124 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing dc6ced685bf46e1e18bd22a777e6a250, disabling compactions & flushes 2023-07-23 23:07:59,124 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250. 2023-07-23 23:07:59,124 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250. 2023-07-23 23:07:59,124 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250. after waiting 0 ms 2023-07-23 23:07:59,124 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250. 2023-07-23 23:07:59,124 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250. 2023-07-23 23:07:59,124 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for dc6ced685bf46e1e18bd22a777e6a250: 2023-07-23 23:07:59,132 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-23 23:07:59,136 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690153679136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153679136"}]},"ts":"1690153679136"} 2023-07-23 23:07:59,137 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690153679136"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153679136"}]},"ts":"1690153679136"} 2023-07-23 23:07:59,153 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-23 23:07:59,155 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-23 23:07:59,155 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153679155"}]},"ts":"1690153679155"} 2023-07-23 23:07:59,157 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-23 23:07:59,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 23:07:59,164 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-23 23:07:59,165 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-23 23:07:59,165 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-23 23:07:59,165 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-23 23:07:59,165 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-23 23:07:59,166 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=dc6ced685bf46e1e18bd22a777e6a250, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3570e7df4d2983406cfd49d0d2eac547, ASSIGN}] 2023-07-23 23:07:59,169 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3570e7df4d2983406cfd49d0d2eac547, ASSIGN 2023-07-23 23:07:59,169 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=dc6ced685bf46e1e18bd22a777e6a250, ASSIGN 2023-07-23 23:07:59,175 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3570e7df4d2983406cfd49d0d2eac547, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38881,1690153558819; forceNewPlan=false, retain=false 2023-07-23 23:07:59,175 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=dc6ced685bf46e1e18bd22a777e6a250, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39259,1690153558742; forceNewPlan=false, retain=false 2023-07-23 23:07:59,325 INFO [jenkins-hbase4:43049] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-23 23:07:59,328 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=3570e7df4d2983406cfd49d0d2eac547, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:59,328 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=dc6ced685bf46e1e18bd22a777e6a250, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:59,328 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690153679328"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153679328"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153679328"}]},"ts":"1690153679328"} 2023-07-23 23:07:59,328 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690153679328"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153679328"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153679328"}]},"ts":"1690153679328"} 2023-07-23 23:07:59,331 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 3570e7df4d2983406cfd49d0d2eac547, server=jenkins-hbase4.apache.org,38881,1690153558819}] 2023-07-23 23:07:59,332 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure dc6ced685bf46e1e18bd22a777e6a250, server=jenkins-hbase4.apache.org,39259,1690153558742}] 2023-07-23 23:07:59,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 23:07:59,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250. 2023-07-23 23:07:59,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547. 2023-07-23 23:07:59,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dc6ced685bf46e1e18bd22a777e6a250, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250.', STARTKEY => '', ENDKEY => '1'} 2023-07-23 23:07:59,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3570e7df4d2983406cfd49d0d2eac547, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547.', STARTKEY => '1', ENDKEY => ''} 2023-07-23 23:07:59,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547. service=AccessControlService 2023-07-23 23:07:59,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250. service=AccessControlService 2023-07-23 23:07:59,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 23:07:59,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-23 23:07:59,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 3570e7df4d2983406cfd49d0d2eac547 2023-07-23 23:07:59,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp dc6ced685bf46e1e18bd22a777e6a250 2023-07-23 23:07:59,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:07:59,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dc6ced685bf46e1e18bd22a777e6a250 2023-07-23 23:07:59,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-23 23:07:59,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3570e7df4d2983406cfd49d0d2eac547 2023-07-23 23:07:59,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3570e7df4d2983406cfd49d0d2eac547 2023-07-23 23:07:59,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dc6ced685bf46e1e18bd22a777e6a250 2023-07-23 23:07:59,494 INFO [StoreOpener-dc6ced685bf46e1e18bd22a777e6a250-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dc6ced685bf46e1e18bd22a777e6a250 2023-07-23 23:07:59,495 INFO [StoreOpener-3570e7df4d2983406cfd49d0d2eac547-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3570e7df4d2983406cfd49d0d2eac547 2023-07-23 23:07:59,496 DEBUG [StoreOpener-dc6ced685bf46e1e18bd22a777e6a250-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithSkipTmp/dc6ced685bf46e1e18bd22a777e6a250/cf 2023-07-23 23:07:59,496 DEBUG [StoreOpener-dc6ced685bf46e1e18bd22a777e6a250-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithSkipTmp/dc6ced685bf46e1e18bd22a777e6a250/cf 2023-07-23 23:07:59,497 DEBUG [StoreOpener-3570e7df4d2983406cfd49d0d2eac547-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithSkipTmp/3570e7df4d2983406cfd49d0d2eac547/cf 2023-07-23 23:07:59,497 DEBUG [StoreOpener-3570e7df4d2983406cfd49d0d2eac547-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithSkipTmp/3570e7df4d2983406cfd49d0d2eac547/cf 2023-07-23 23:07:59,497 INFO [StoreOpener-dc6ced685bf46e1e18bd22a777e6a250-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dc6ced685bf46e1e18bd22a777e6a250 columnFamilyName cf 2023-07-23 23:07:59,497 INFO [StoreOpener-3570e7df4d2983406cfd49d0d2eac547-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3570e7df4d2983406cfd49d0d2eac547 columnFamilyName cf 2023-07-23 23:07:59,499 INFO [StoreOpener-3570e7df4d2983406cfd49d0d2eac547-1] regionserver.HStore(310): Store=3570e7df4d2983406cfd49d0d2eac547/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 23:07:59,499 INFO [StoreOpener-dc6ced685bf46e1e18bd22a777e6a250-1] regionserver.HStore(310): Store=dc6ced685bf46e1e18bd22a777e6a250/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-23 23:07:59,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithSkipTmp/dc6ced685bf46e1e18bd22a777e6a250 2023-07-23 23:07:59,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithSkipTmp/3570e7df4d2983406cfd49d0d2eac547 2023-07-23 23:07:59,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithSkipTmp/dc6ced685bf46e1e18bd22a777e6a250 2023-07-23 23:07:59,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithSkipTmp/3570e7df4d2983406cfd49d0d2eac547 2023-07-23 23:07:59,504 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dc6ced685bf46e1e18bd22a777e6a250 2023-07-23 23:07:59,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3570e7df4d2983406cfd49d0d2eac547 2023-07-23 23:07:59,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithSkipTmp/3570e7df4d2983406cfd49d0d2eac547/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 23:07:59,507 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3570e7df4d2983406cfd49d0d2eac547; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70697677, jitterRate=0.05347748100757599}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 23:07:59,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3570e7df4d2983406cfd49d0d2eac547: 2023-07-23 23:07:59,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547., pid=108, masterSystemTime=1690153679483 2023-07-23 23:07:59,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithSkipTmp/dc6ced685bf46e1e18bd22a777e6a250/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-23 23:07:59,508 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dc6ced685bf46e1e18bd22a777e6a250; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62837325, jitterRate=-0.06365089118480682}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-23 23:07:59,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dc6ced685bf46e1e18bd22a777e6a250: 2023-07-23 23:07:59,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250., pid=109, masterSystemTime=1690153679484 2023-07-23 23:07:59,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547. 2023-07-23 23:07:59,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547. 2023-07-23 23:07:59,510 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=3570e7df4d2983406cfd49d0d2eac547, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:59,510 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690153679510"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690153679510"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690153679510"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690153679510"}]},"ts":"1690153679510"} 2023-07-23 23:07:59,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250. 2023-07-23 23:07:59,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250. 2023-07-23 23:07:59,513 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=dc6ced685bf46e1e18bd22a777e6a250, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:59,513 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690153679512"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690153679512"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690153679512"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690153679512"}]},"ts":"1690153679512"} 2023-07-23 23:07:59,520 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-23 23:07:59,520 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-23 23:07:59,520 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure dc6ced685bf46e1e18bd22a777e6a250, server=jenkins-hbase4.apache.org,39259,1690153558742 in 185 msec 2023-07-23 23:07:59,520 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 3570e7df4d2983406cfd49d0d2eac547, server=jenkins-hbase4.apache.org,38881,1690153558819 in 181 msec 2023-07-23 23:07:59,522 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3570e7df4d2983406cfd49d0d2eac547, ASSIGN in 354 msec 2023-07-23 23:07:59,523 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-23 23:07:59,523 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=dc6ced685bf46e1e18bd22a777e6a250, ASSIGN in 354 msec 2023-07-23 23:07:59,524 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-23 23:07:59,524 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153679524"}]},"ts":"1690153679524"} 2023-07-23 23:07:59,525 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-23 23:07:59,528 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-23 23:07:59,528 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-23 23:07:59,530 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34863] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-23 23:07:59,532 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:59,532 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:59,532 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:59,532 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:07:59,533 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 23:07:59,533 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 23:07:59,533 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 23:07:59,534 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-23 23:07:59,535 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 477 msec 2023-07-23 23:07:59,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-23 23:07:59,664 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-23 23:07:59,667 DEBUG [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,667 DEBUG [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250. 2023-07-23 23:07:59,669 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 23:07:59,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 23:07:59,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690153679687 (current time:1690153679687). 2023-07-23 23:07:59,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 23:07:59,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(139): Connect 0x415a5df2 to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:07:59,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6cb17315, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:07:59,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:07:59,724 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:07:59,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x415a5df2 to 127.0.0.1:58893 2023-07-23 23:07:59,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:07:59,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(139): Connect 0x09680379 to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:07:59,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1a4e7a6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:07:59,835 DEBUG [hconnection-0x7d009bec-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:07:59,839 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:07:59,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:07:59,847 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34888, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:07:59,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09680379 to 127.0.0.1:58893 2023-07-23 23:07:59,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:07:59,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-23 23:07:59,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 23:07:59,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 23:07:59,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 23:07:59,857 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 23:07:59,858 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690154279858 2023-07-23 23:07:59,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 23:07:59,858 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,860 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 23:07:59,860 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 23:07:59,861 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 23:07:59,861 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 23:07:59,862 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-23 23:07:59,863 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 23:07:59,864 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690154279864 2023-07-23 23:07:59,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,897 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-23 23:07:59,897 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:07:59,898 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-23 23:07:59,899 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-23 23:07:59,899 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,899 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,900 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:59,900 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:59,900 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:59,900 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:07:59,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:59,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:59,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:07:59,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:59,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:59,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:07:59,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,903 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:59,903 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:59,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-23 23:07:59,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,903 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,903 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 23:07:59,903 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,903 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:59,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-23 23:07:59,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,903 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,903 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 23:07:59,904 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 23:07:59,904 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 23:07:59,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-23 23:07:59,904 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:07:59,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,904 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,913 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 23:07:59,913 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 23:07:59,913 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:07:59,904 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 23:07:59,915 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 23:07:59,916 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 23:07:59,916 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39259,1690153558742' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 23:07:59,913 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 23:07:59,916 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34863,1690153558866' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 23:07:59,916 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,916 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 23:07:59,916 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:07:59,917 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 23:07:59,917 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 23:07:59,917 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1690153558819' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 23:07:59,924 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:59,924 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:59,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:59,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:59,924 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,925 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,925 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:07:59,926 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:59,926 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:59,926 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,926 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:07:59,926 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,926 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:07:59,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:59,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:59,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:59,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:59,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:59,928 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39259,1690153558742' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 23:07:59,928 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5df574ef[Count = 1] remaining members to acquire global barrier 2023-07-23 23:07:59,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:59,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:59,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:59,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:59,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:59,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:59,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:59,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:59,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:59,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1690153558819' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 23:07:59,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5df574ef[Count = 0] remaining members to acquire global barrier 2023-07-23 23:07:59,932 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-23 23:07:59,932 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,933 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,933 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,933 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,933 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,933 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 23:07:59,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,934 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 23:07:59,934 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 23:07:59,934 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34863,1690153558866' in zk 2023-07-23 23:07:59,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,934 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 23:07:59,934 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 23:07:59,934 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 23:07:59,934 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250. 2023-07-23 23:07:59,934 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250. started... 2023-07-23 23:07:59,934 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 23:07:59,934 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 23:07:59,934 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dc6ced685bf46e1e18bd22a777e6a250: 2023-07-23 23:07:59,935 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,935 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 23:07:59,935 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 23:07:59,935 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 23:07:59,935 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:07:59,936 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 23:07:59,936 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:59,937 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:59,937 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 23:07:59,943 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547. 2023-07-23 23:07:59,943 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547. started... 2023-07-23 23:07:59,951 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3570e7df4d2983406cfd49d0d2eac547: 2023-07-23 23:07:59,952 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,952 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 23:07:59,952 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-23 23:07:59,960 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:07:59,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 23:07:59,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-23 23:07:59,961 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 23:07:59,980 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250. completed. 2023-07-23 23:07:59,981 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250. 2023-07-23 23:07:59,981 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 23:07:59,981 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 23:07:59,981 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:59,981 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 23:07:59,981 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39259,1690153558742' in zk 2023-07-23 23:07:59,984 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547. completed. 2023-07-23 23:07:59,984 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547. 2023-07-23 23:07:59,984 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 23:07:59,985 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 23:07:59,985 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:59,985 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:59,985 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 23:07:59,985 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 23:07:59,985 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:07:59,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:59,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:59,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:59,985 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 23:07:59,985 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38881,1690153558819' in zk 2023-07-23 23:07:59,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:59,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:59,989 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 23:07:59,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,989 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:59,989 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:07:59,989 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 23:07:59,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:59,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:59,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:59,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:59,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:59,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:59,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:59,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39259,1690153558742': 2023-07-23 23:07:59,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39259,1690153558742' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-23 23:07:59,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:59,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:07:59,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:07:59,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:07:59,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:07:59,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:59,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:59,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:59,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:07:59,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:07:59,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:07:59,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:07:59,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38881,1690153558819': 2023-07-23 23:07:59,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1690153558819' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-23 23:07:59,998 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-23 23:07:59,998 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 23:07:59,998 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 23:07:59,998 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:07:59,998 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 23:08:00,000 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,000 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,000 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:08:00,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:08:00,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:08:00,000 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,000 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,000 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:08:00,000 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:08:00,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:08:00,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,001 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:00,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:08:00,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:08:00,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:08:00,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:08:00,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:08:00,001 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:08:00,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:08:00,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:08:00,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,002 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:08:00,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:00,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:08:00,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:08:00,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:08:00,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,004 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:00,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:00,004 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:08:00,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:08:00,005 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:08:00,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:08:00,008 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:08:00,008 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:08:00,008 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,008 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:08:00,008 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:08:00,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:08:00,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:08:00,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:08:00,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:08:00,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:08:00,008 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:08:00,008 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:08:00,008 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:08:00,009 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:00,009 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,009 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:08:00,009 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,009 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:08:00,009 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:00,009 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,009 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,008 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:08:00,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:08:00,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:08:00,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:08:00,008 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,008 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:08:00,009 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:08:00,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:08:00,011 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,011 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 23:08:00,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:08:00,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:08:00,012 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-23 23:08:00,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,025 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,072 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-23 23:08:00,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,072 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690153679858Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1690153680024 (+166 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690153680024Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690153680024Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690153680028 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690153680048 (+20 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690153680072 (+24 ms) 2023-07-23 23:08:00,075 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 23:08:00,077 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 216 msec 2023-07-23 23:08:00,161 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:08:00,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 23:08:00,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 23:08:00,165 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39259] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 23:08:00,166 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38881] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547. with WAL disabled. Data may be lost in the event of a crash. 2023-07-23 23:08:00,169 DEBUG [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,169 DEBUG [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250. 2023-07-23 23:08:00,170 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-23 23:08:00,180 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 23:08:00,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690153680181 (current time:1690153680181). 2023-07-23 23:08:00,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-23 23:08:00,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(139): Connect 0x7b3e2f17 to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:08:00,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2180467, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:08:00,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:08:00,193 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54000, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:08:00,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b3e2f17 to 127.0.0.1:58893 2023-07-23 23:08:00,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:08:00,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(139): Connect 0x1ea068bc to 127.0.0.1:58893 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-23 23:08:00,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@146cbae8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-23 23:08:00,206 DEBUG [hconnection-0x5615af3e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:08:00,209 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54012, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:08:00,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-23 23:08:00,215 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34904, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-23 23:08:00,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1ea068bc to 127.0.0.1:58893 2023-07-23 23:08:00,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:08:00,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-23 23:08:00,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-23 23:08:00,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 23:08:00,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 23:08:00,221 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 23:08:00,222 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690154280222 2023-07-23 23:08:00,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-23 23:08:00,222 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,223 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-23 23:08:00,223 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-23 23:08:00,224 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-23 23:08:00,225 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 23:08:00,226 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-23 23:08:00,227 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 23:08:00,227 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690154280227 2023-07-23 23:08:00,243 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,243 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-23 23:08:00,243 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:08:00,245 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-23 23:08:00,245 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-23 23:08:00,245 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,245 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,247 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:08:00,248 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:00,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:08:00,248 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:08:00,247 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:08:00,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:08:00,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:08:00,248 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:00,248 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:08:00,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:08:00,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:08:00,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:08:00,248 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:08:00,248 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-23 23:08:00,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,249 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,249 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,249 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-23 23:08:00,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-23 23:08:00,249 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 23:08:00,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-23 23:08:00,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,250 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 23:08:00,250 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-23 23:08:00,250 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,250 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,250 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 23:08:00,250 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:08:00,250 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 23:08:00,250 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:08:00,251 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 23:08:00,253 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 23:08:00,250 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,253 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38881,1690153558819' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 23:08:00,253 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-23 23:08:00,253 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-23 23:08:00,253 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 23:08:00,254 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-23 23:08:00,254 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 23:08:00,254 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-23 23:08:00,254 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34863,1690153558866' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 23:08:00,254 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39259,1690153558742' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-23 23:08:00,256 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,256 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:08:00,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:08:00,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:08:00,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:08:00,257 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:00,257 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,257 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,257 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:08:00,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:08:00,257 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,257 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,257 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:08:00,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:08:00,257 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,257 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-23 23:08:00,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:08:00,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:00,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:08:00,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:08:00,259 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38881,1690153558819' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 23:08:00,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7769a206[Count = 1] remaining members to acquire global barrier 2023-07-23 23:08:00,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:00,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:08:00,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:08:00,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:08:00,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:08:00,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:08:00,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:00,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:08:00,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:08:00,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39259,1690153558742' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-23 23:08:00,263 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7769a206[Count = 0] remaining members to acquire global barrier 2023-07-23 23:08:00,263 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-23 23:08:00,263 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,273 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,273 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,273 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,274 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:08:00,274 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 23:08:00,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,274 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 23:08:00,274 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-23 23:08:00,274 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 23:08:00,274 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34863,1690153558866' in zk 2023-07-23 23:08:00,274 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 23:08:00,274 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 23:08:00,274 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:00,274 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-23 23:08:00,275 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547. 2023-07-23 23:08:00,275 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547. started... 2023-07-23 23:08:00,275 INFO [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3570e7df4d2983406cfd49d0d2eac547 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-23 23:08:00,275 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-23 23:08:00,275 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-23 23:08:00,275 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250. 2023-07-23 23:08:00,276 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250. started... 2023-07-23 23:08:00,276 INFO [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] regionserver.HRegion(2745): Flushing dc6ced685bf46e1e18bd22a777e6a250 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-23 23:08:00,276 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 23:08:00,276 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:08:00,276 DEBUG [member: 'jenkins-hbase4.apache.org,34863,1690153558866' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 23:08:00,315 INFO [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230723da3bf2385361414382784ee87076f3b9 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230723da3bf2385361414382784ee87076f3b9 2023-07-23 23:08:00,323 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:08:00,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 23:08:00,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-23 23:08:00,325 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-23 23:08:00,357 INFO [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307238543c437a4e4462ca8e72ea5f643f1c3 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307238543c437a4e4462ca8e72ea5f643f1c3 2023-07-23 23:08:00,363 INFO [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithSkipTmp/dc6ced685bf46e1e18bd22a777e6a250/.tmp/cf/8133369c1ed14aae9cf5fa1c1e39d5db 2023-07-23 23:08:00,369 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithSkipTmp/dc6ced685bf46e1e18bd22a777e6a250/.tmp/cf/8133369c1ed14aae9cf5fa1c1e39d5db as hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithSkipTmp/dc6ced685bf46e1e18bd22a777e6a250/cf/8133369c1ed14aae9cf5fa1c1e39d5db 2023-07-23 23:08:00,374 INFO [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithSkipTmp/dc6ced685bf46e1e18bd22a777e6a250/cf/8133369c1ed14aae9cf5fa1c1e39d5db, entries=4, sequenceid=6, filesize=5.6 K 2023-07-23 23:08:00,375 INFO [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for dc6ced685bf46e1e18bd22a777e6a250 in 99ms, sequenceid=6, compaction requested=false 2023-07-23 23:08:00,375 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-23 23:08:00,376 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for dc6ced685bf46e1e18bd22a777e6a250: 2023-07-23 23:08:00,376 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,376 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 23:08:00,376 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithSkipTmp/dc6ced685bf46e1e18bd22a777e6a250/cf/8133369c1ed14aae9cf5fa1c1e39d5db] hfiles 2023-07-23 23:08:00,376 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithSkipTmp/dc6ced685bf46e1e18bd22a777e6a250/cf/8133369c1ed14aae9cf5fa1c1e39d5db for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,380 INFO [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithSkipTmp/3570e7df4d2983406cfd49d0d2eac547/.tmp/cf/ec882a0e6dd34ebba05bbd124b24e608 2023-07-23 23:08:00,394 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithSkipTmp/3570e7df4d2983406cfd49d0d2eac547/.tmp/cf/ec882a0e6dd34ebba05bbd124b24e608 as hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithSkipTmp/3570e7df4d2983406cfd49d0d2eac547/cf/ec882a0e6dd34ebba05bbd124b24e608 2023-07-23 23:08:00,397 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250. completed. 2023-07-23 23:08:00,397 DEBUG [rs(jenkins-hbase4.apache.org,39259,1690153558742)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250. 2023-07-23 23:08:00,397 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 23:08:00,397 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 23:08:00,403 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:00,403 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 23:08:00,403 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39259,1690153558742' in zk 2023-07-23 23:08:00,405 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:00,405 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 23:08:00,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:00,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:08:00,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:08:00,405 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:08:00,405 DEBUG [member: 'jenkins-hbase4.apache.org,39259,1690153558742' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 23:08:00,409 INFO [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithSkipTmp/3570e7df4d2983406cfd49d0d2eac547/cf/ec882a0e6dd34ebba05bbd124b24e608, entries=46, sequenceid=6, filesize=13.2 K 2023-07-23 23:08:00,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:08:00,410 INFO [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 3570e7df4d2983406cfd49d0d2eac547 in 135ms, sequenceid=6, compaction requested=false 2023-07-23 23:08:00,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:08:00,413 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3570e7df4d2983406cfd49d0d2eac547: 2023-07-23 23:08:00,413 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,414 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-23 23:08:00,414 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithSkipTmp/3570e7df4d2983406cfd49d0d2eac547/cf/ec882a0e6dd34ebba05bbd124b24e608] hfiles 2023-07-23 23:08:00,414 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithSkipTmp/3570e7df4d2983406cfd49d0d2eac547/cf/ec882a0e6dd34ebba05bbd124b24e608 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:08:00,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:00,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:08:00,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:08:00,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:00,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:08:00,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,39259,1690153558742': 2023-07-23 23:08:00,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39259,1690153558742' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-23 23:08:00,433 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547. completed. 2023-07-23 23:08:00,433 DEBUG [rs(jenkins-hbase4.apache.org,38881,1690153558819)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547. 2023-07-23 23:08:00,434 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-23 23:08:00,434 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-23 23:08:00,434 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:08:00,434 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-23 23:08:00,434 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38881,1690153558819' in zk 2023-07-23 23:08:00,435 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:08:00,435 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-23 23:08:00,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:08:00,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:08:00,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:08:00,436 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:08:00,436 DEBUG [member: 'jenkins-hbase4.apache.org,38881,1690153558819' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-23 23:08:00,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:08:00,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:08:00,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:08:00,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:00,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:08:00,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:08:00,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:00,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:08:00,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:08:00,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,38881,1690153558819': 2023-07-23 23:08:00,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38881,1690153558819' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-23 23:08:00,443 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-23 23:08:00,443 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-23 23:08:00,443 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-23 23:08:00,443 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,443 INFO [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-23 23:08:00,446 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,446 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,446 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:08:00,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,446 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:08:00,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:08:00,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:08:00,447 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:08:00,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:08:00,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:08:00,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,447 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:00,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,448 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:08:00,450 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:00,450 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:08:00,451 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:08:00,454 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,454 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:08:00,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,454 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-23 23:08:00,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-23 23:08:00,459 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:08:00,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:08:00,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-23 23:08:00,464 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:08:00,464 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,464 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:00,464 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:08:00,464 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:08:00,464 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:08:00,464 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-23 23:08:00,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:08:00,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:08:00,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:08:00,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:08:00,464 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:08:00,464 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-23 23:08:00,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-23 23:08:00,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-23 23:08:00,465 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,465 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:08:00,465 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,465 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:08:00,465 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:00,465 DEBUG [(jenkins-hbase4.apache.org,43049,1690153556996)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-23 23:08:00,465 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,465 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,467 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,465 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,467 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,467 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-23 23:08:00,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-23 23:08:00,468 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:08:00,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:08:00,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307238543c437a4e4462ca8e72ea5f643f1c3, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230723da3bf2385361414382784ee87076f3b9] mob files 2023-07-23 23:08:00,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307238543c437a4e4462ca8e72ea5f643f1c3 2023-07-23 23:08:00,468 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230723da3bf2385361414382784ee87076f3b9 2023-07-23 23:08:00,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-23 23:08:00,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-23 23:08:00,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-23 23:08:00,472 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp because node does not exist (not an error) 2023-07-23 23:08:00,525 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:08:00,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 23:08:00,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-23 23:08:00,527 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-23 23:08:00,827 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:08:00,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 23:08:00,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-23 23:08:00,828 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-23 23:08:00,886 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,887 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:00,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:01,026 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-23 23:08:01,026 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:01,026 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:01,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690153680222Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1690153680886 (+664 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690153680886Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1690153680886Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1690153680899 (+13 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690153680955 (+56 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690153681026 (+71 ms) 2023-07-23 23:08:01,030 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-23 23:08:01,032 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 807 msec 2023-07-23 23:08:01,329 DEBUG [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-23 23:08:01,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-23 23:08:01,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-23 23:08:01,330 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153681330 2023-07-23 23:08:01,330 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:40459, tgtDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153681330, rawTgtDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153681330, srcFsUri=hdfs://localhost:40459, srcDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f 2023-07-23 23:08:01,357 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:40459, inputRoot=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f 2023-07-23 23:08:01,357 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_304340612_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153681330, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153681330/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:01,357 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:40459, inputRoot=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f, snapshotDir=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-23 23:08:01,374 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153681330/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:01,436 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-23 23:08:01,437 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-23 23:08:01,437 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-23 23:08:01,439 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-23 23:08:02,641 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/hadoop-6035055078367236693.jar 2023-07-23 23:08:02,642 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-23 23:08:02,642 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-23 23:08:02,683 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0006_000001 (auth:SIMPLE) 2023-07-23 23:08:02,759 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/hadoop-2438721997938990480.jar 2023-07-23 23:08:02,759 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-23 23:08:02,760 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-23 23:08:02,761 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-23 23:08:02,761 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-23 23:08:02,762 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-23 23:08:02,762 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-23 23:08:02,763 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-23 23:08:02,763 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-23 23:08:02,764 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-23 23:08:02,765 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-23 23:08:02,765 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-23 23:08:02,766 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-23 23:08:02,766 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-23 23:08:02,767 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-23 23:08:02,767 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-23 23:08:02,768 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-23 23:08:02,769 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:08:02,770 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:08:02,771 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 23:08:02,771 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:08:02,771 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-23 23:08:02,772 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 23:08:02,773 DEBUG [Listener at jenkins-hbase4.apache.org/42491] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-23 23:08:03,308 WARN [Listener at jenkins-hbase4.apache.org/42491] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-23 23:08:03,312 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-23 23:08:03,314 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-23 23:08:03,399 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 23:08:03,400 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-23 23:08:03,679 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0007_000001 (auth:SIMPLE) 2023-07-23 23:08:04,378 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 23:08:09,658 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0007_000001 (auth:SIMPLE) 2023-07-23 23:08:11,948 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0007_000001 (auth:SIMPLE) 2023-07-23 23:08:16,197 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0007_000001 (auth:SIMPLE) 2023-07-23 23:08:17,539 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-23 23:08:17,540 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-23 23:08:17,572 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:17,572 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-23 23:08:17,573 INFO [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-23 23:08:17,573 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2080736097_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:17,574 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-23 23:08:17,574 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-23 23:08:17,574 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2080736097_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153681330/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153681330/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:17,575 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153681330/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-23 23:08:17,575 DEBUG [Listener at jenkins-hbase4.apache.org/42491] snapshot.TestExportSnapshot(367): hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/export-test/export-1690153681330/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-23 23:08:17,585 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:17,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:17,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:17,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-23 23:08:17,592 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153697592"}]},"ts":"1690153697592"} 2023-07-23 23:08:17,594 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-23 23:08:17,595 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-23 23:08:17,596 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=dc6ced685bf46e1e18bd22a777e6a250, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3570e7df4d2983406cfd49d0d2eac547, UNASSIGN}] 2023-07-23 23:08:17,598 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=dc6ced685bf46e1e18bd22a777e6a250, UNASSIGN 2023-07-23 23:08:17,599 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3570e7df4d2983406cfd49d0d2eac547, UNASSIGN 2023-07-23 23:08:17,600 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=dc6ced685bf46e1e18bd22a777e6a250, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:17,600 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=3570e7df4d2983406cfd49d0d2eac547, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:08:17,600 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690153697600"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153697600"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153697600"}]},"ts":"1690153697600"} 2023-07-23 23:08:17,600 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690153697600"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690153697600"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690153697600"}]},"ts":"1690153697600"} 2023-07-23 23:08:17,602 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure dc6ced685bf46e1e18bd22a777e6a250, server=jenkins-hbase4.apache.org,39259,1690153558742}] 2023-07-23 23:08:17,603 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 3570e7df4d2983406cfd49d0d2eac547, server=jenkins-hbase4.apache.org,38881,1690153558819}] 2023-07-23 23:08:17,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-23 23:08:17,754 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dc6ced685bf46e1e18bd22a777e6a250 2023-07-23 23:08:17,754 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3570e7df4d2983406cfd49d0d2eac547 2023-07-23 23:08:17,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dc6ced685bf46e1e18bd22a777e6a250, disabling compactions & flushes 2023-07-23 23:08:17,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3570e7df4d2983406cfd49d0d2eac547, disabling compactions & flushes 2023-07-23 23:08:17,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250. 2023-07-23 23:08:17,755 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547. 2023-07-23 23:08:17,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250. 2023-07-23 23:08:17,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547. 2023-07-23 23:08:17,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250. after waiting 0 ms 2023-07-23 23:08:17,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547. after waiting 0 ms 2023-07-23 23:08:17,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250. 2023-07-23 23:08:17,755 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547. 2023-07-23 23:08:17,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithSkipTmp/dc6ced685bf46e1e18bd22a777e6a250/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 23:08:17,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:08:17,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/default/testtb-testExportFileSystemStateWithSkipTmp/3570e7df4d2983406cfd49d0d2eac547/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 23:08:17,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250. 2023-07-23 23:08:17,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dc6ced685bf46e1e18bd22a777e6a250: 2023-07-23 23:08:17,771 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:08:17,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547. 2023-07-23 23:08:17,772 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3570e7df4d2983406cfd49d0d2eac547: 2023-07-23 23:08:17,773 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dc6ced685bf46e1e18bd22a777e6a250 2023-07-23 23:08:17,773 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=dc6ced685bf46e1e18bd22a777e6a250, regionState=CLOSED 2023-07-23 23:08:17,773 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3570e7df4d2983406cfd49d0d2eac547 2023-07-23 23:08:17,773 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690153697773"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153697773"}]},"ts":"1690153697773"} 2023-07-23 23:08:17,774 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=3570e7df4d2983406cfd49d0d2eac547, regionState=CLOSED 2023-07-23 23:08:17,774 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690153697774"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690153697774"}]},"ts":"1690153697774"} 2023-07-23 23:08:17,776 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-23 23:08:17,776 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure dc6ced685bf46e1e18bd22a777e6a250, server=jenkins-hbase4.apache.org,39259,1690153558742 in 173 msec 2023-07-23 23:08:17,777 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-23 23:08:17,777 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 3570e7df4d2983406cfd49d0d2eac547, server=jenkins-hbase4.apache.org,38881,1690153558819 in 173 msec 2023-07-23 23:08:17,778 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=dc6ced685bf46e1e18bd22a777e6a250, UNASSIGN in 180 msec 2023-07-23 23:08:17,779 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-23 23:08:17,779 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=3570e7df4d2983406cfd49d0d2eac547, UNASSIGN in 181 msec 2023-07-23 23:08:17,780 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690153697780"}]},"ts":"1690153697780"} 2023-07-23 23:08:17,781 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-23 23:08:17,783 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-23 23:08:17,786 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 197 msec 2023-07-23 23:08:17,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-23 23:08:17,895 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-23 23:08:17,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:17,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:17,900 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:17,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:17,901 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:17,902 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34863] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:17,905 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/dc6ced685bf46e1e18bd22a777e6a250 2023-07-23 23:08:17,905 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3570e7df4d2983406cfd49d0d2eac547 2023-07-23 23:08:17,906 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:17,906 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:17,906 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:17,906 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:17,906 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 23:08:17,907 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 23:08:17,906 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 23:08:17,909 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/dc6ced685bf46e1e18bd22a777e6a250/cf, FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/dc6ced685bf46e1e18bd22a777e6a250/recovered.edits] 2023-07-23 23:08:17,910 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3570e7df4d2983406cfd49d0d2eac547/cf, FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3570e7df4d2983406cfd49d0d2eac547/recovered.edits] 2023-07-23 23:08:17,911 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-23 23:08:17,912 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:17,912 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:08:17,912 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:17,912 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:08:17,913 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:17,913 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:17,913 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:08:17,913 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-23 23:08:17,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-23 23:08:17,918 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3570e7df4d2983406cfd49d0d2eac547/cf/ec882a0e6dd34ebba05bbd124b24e608 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/3570e7df4d2983406cfd49d0d2eac547/cf/ec882a0e6dd34ebba05bbd124b24e608 2023-07-23 23:08:17,922 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/dc6ced685bf46e1e18bd22a777e6a250/cf/8133369c1ed14aae9cf5fa1c1e39d5db to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/dc6ced685bf46e1e18bd22a777e6a250/cf/8133369c1ed14aae9cf5fa1c1e39d5db 2023-07-23 23:08:17,924 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3570e7df4d2983406cfd49d0d2eac547/recovered.edits/9.seqid to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/3570e7df4d2983406cfd49d0d2eac547/recovered.edits/9.seqid 2023-07-23 23:08:17,925 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/3570e7df4d2983406cfd49d0d2eac547 2023-07-23 23:08:17,926 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/dc6ced685bf46e1e18bd22a777e6a250/recovered.edits/9.seqid to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/dc6ced685bf46e1e18bd22a777e6a250/recovered.edits/9.seqid 2023-07-23 23:08:17,926 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/dc6ced685bf46e1e18bd22a777e6a250 2023-07-23 23:08:17,926 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-23 23:08:17,927 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-23 23:08:17,928 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-23 23:08:17,932 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307238543c437a4e4462ca8e72ea5f643f1c3 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307238543c437a4e4462ca8e72ea5f643f1c3 2023-07-23 23:08:17,934 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230723da3bf2385361414382784ee87076f3b9 to hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230723da3bf2385361414382784ee87076f3b9 2023-07-23 23:08:17,934 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-23 23:08:17,937 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:17,939 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-23 23:08:17,943 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-23 23:08:17,944 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:17,944 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-23 23:08:17,944 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690153697944"}]},"ts":"9223372036854775807"} 2023-07-23 23:08:17,944 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690153697944"}]},"ts":"9223372036854775807"} 2023-07-23 23:08:17,946 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-23 23:08:17,946 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => dc6ced685bf46e1e18bd22a777e6a250, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690153679056.dc6ced685bf46e1e18bd22a777e6a250.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 3570e7df4d2983406cfd49d0d2eac547, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690153679056.3570e7df4d2983406cfd49d0d2eac547.', STARTKEY => '1', ENDKEY => ''}] 2023-07-23 23:08:17,946 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-23 23:08:17,946 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690153697946"}]},"ts":"9223372036854775807"} 2023-07-23 23:08:17,952 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-23 23:08:17,954 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:17,960 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 58 msec 2023-07-23 23:08:18,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-23 23:08:18,016 INFO [Listener at jenkins-hbase4.apache.org/42491] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-23 23:08:18,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-23 23:08:18,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:18,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-23 23:08:18,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-23 23:08:18,069 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763 (was 762) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:42491 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-262162319_1 at /127.0.0.1:60016 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5c344f42-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2080736097_17 at /127.0.0.1:57932 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5c344f42-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2080736097_17 at /127.0.0.1:34798 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1506713691) connection to jenkins-hbase4.apache.org/172.31.14.131:46671 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-668406304_17 at /127.0.0.1:60040 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5c344f42-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5433 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5c344f42-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=910 (was 914), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=562 (was 550) - SystemLoadAverage LEAK? -, ProcessCount=178 (was 181), AvailableMemoryMB=4654 (was 4963) 2023-07-23 23:08:18,069 WARN [Listener at jenkins-hbase4.apache.org/42491] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-23 23:08:18,069 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-23 23:08:18,083 INFO [Listener at jenkins-hbase4.apache.org/42491] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 23:08:22,381 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690153567960_0007_000001 (auth:SIMPLE) 2023-07-23 23:08:23,346 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-23 23:08:32,212 INFO [Listener at jenkins-hbase4.apache.org/42491] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 23:08:46,362 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-23 23:08:46,362 INFO [Listener at jenkins-hbase4.apache.org/42491] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 23:08:46,473 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-23 23:08:46,484 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-23 23:08:46,485 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-23 23:08:46,499 INFO [Listener at jenkins-hbase4.apache.org/42491] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-23 23:08:46,504 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-23 23:08:46,504 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-23 23:08:46,504 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-23 23:08:46,505 INFO [Listener at jenkins-hbase4.apache.org/42491] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-23 23:08:46,505 DEBUG [Listener at jenkins-hbase4.apache.org/42491] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x092a69b5 to 127.0.0.1:58893 2023-07-23 23:08:46,505 DEBUG [Listener at jenkins-hbase4.apache.org/42491] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:08:46,505 DEBUG [Listener at jenkins-hbase4.apache.org/42491] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-23 23:08:46,505 DEBUG [Listener at jenkins-hbase4.apache.org/42491] util.JVMClusterUtil(257): Found active master hash=2083216077, stopped=false 2023-07-23 23:08:46,506 DEBUG [Listener at jenkins-hbase4.apache.org/42491] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:08:46,506 DEBUG [Listener at jenkins-hbase4.apache.org/42491] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-23 23:08:46,506 INFO [Listener at jenkins-hbase4.apache.org/42491] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,43049,1690153556996 2023-07-23 23:08:46,507 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 23:08:46,507 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 23:08:46,507 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 23:08:46,508 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-23 23:08:46,508 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 23:08:46,508 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 23:08:46,508 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 23:08:46,508 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 23:08:46,508 INFO [Listener at jenkins-hbase4.apache.org/42491] procedure2.ProcedureExecutor(629): Stopping 2023-07-23 23:08:46,508 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-23 23:08:46,508 DEBUG [Listener at jenkins-hbase4.apache.org/42491] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d8e9868 to 127.0.0.1:58893 2023-07-23 23:08:46,509 DEBUG [Listener at jenkins-hbase4.apache.org/42491] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:08:46,509 INFO [Listener at jenkins-hbase4.apache.org/42491] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39259,1690153558742' ***** 2023-07-23 23:08:46,509 DEBUG [Listener at jenkins-hbase4.apache.org/42491] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:08:46,509 INFO [Listener at jenkins-hbase4.apache.org/42491] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-23 23:08:46,510 INFO [Listener at jenkins-hbase4.apache.org/42491] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38881,1690153558819' ***** 2023-07-23 23:08:46,510 INFO [RS:0;jenkins-hbase4:39259] regionserver.HeapMemoryManager(220): Stopping 2023-07-23 23:08:46,510 DEBUG [Listener at jenkins-hbase4.apache.org/42491] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:08:46,510 INFO [Listener at jenkins-hbase4.apache.org/42491] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-23 23:08:46,510 INFO [RS:0;jenkins-hbase4:39259] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-23 23:08:46,510 INFO [Listener at jenkins-hbase4.apache.org/42491] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34863,1690153558866' ***** 2023-07-23 23:08:46,510 INFO [RS:1;jenkins-hbase4:38881] regionserver.HeapMemoryManager(220): Stopping 2023-07-23 23:08:46,510 DEBUG [Listener at jenkins-hbase4.apache.org/42491] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:08:46,510 INFO [RS:0;jenkins-hbase4:39259] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-23 23:08:46,510 INFO [Listener at jenkins-hbase4.apache.org/42491] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-23 23:08:46,510 INFO [RS:0;jenkins-hbase4:39259] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:46,510 INFO [RS:1;jenkins-hbase4:38881] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-23 23:08:46,510 DEBUG [RS:0;jenkins-hbase4:39259] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5fd93a1f to 127.0.0.1:58893 2023-07-23 23:08:46,510 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-23 23:08:46,510 DEBUG [RS:0;jenkins-hbase4:39259] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:08:46,510 INFO [RS:2;jenkins-hbase4:34863] regionserver.HeapMemoryManager(220): Stopping 2023-07-23 23:08:46,510 INFO [RS:1;jenkins-hbase4:38881] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-23 23:08:46,513 INFO [RS:0;jenkins-hbase4:39259] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39259,1690153558742; all regions closed. 2023-07-23 23:08:46,513 INFO [RS:1;jenkins-hbase4:38881] regionserver.HRegionServer(3305): Received CLOSE for 9badc324f1e32204a0086773ddf03343 2023-07-23 23:08:46,513 INFO [RS:1;jenkins-hbase4:38881] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:08:46,513 DEBUG [RS:1;jenkins-hbase4:38881] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3860d335 to 127.0.0.1:58893 2023-07-23 23:08:46,513 DEBUG [RS:1;jenkins-hbase4:38881] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:08:46,511 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-23 23:08:46,511 INFO [RS:2;jenkins-hbase4:34863] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-23 23:08:46,514 INFO [RS:2;jenkins-hbase4:34863] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-23 23:08:46,511 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-23 23:08:46,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9badc324f1e32204a0086773ddf03343, disabling compactions & flushes 2023-07-23 23:08:46,519 INFO [RS:2;jenkins-hbase4:34863] regionserver.HRegionServer(3305): Received CLOSE for 5f64a7f0784611af52afe26606ce595c 2023-07-23 23:08:46,519 INFO [RS:1;jenkins-hbase4:38881] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-23 23:08:46,519 INFO [RS:2;jenkins-hbase4:34863] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:08:46,519 INFO [RS:1;jenkins-hbase4:38881] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-23 23:08:46,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690153561769.9badc324f1e32204a0086773ddf03343. 2023-07-23 23:08:46,520 INFO [RS:1;jenkins-hbase4:38881] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-23 23:08:46,520 DEBUG [RS:2;jenkins-hbase4:34863] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x217a9942 to 127.0.0.1:58893 2023-07-23 23:08:46,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5f64a7f0784611af52afe26606ce595c, disabling compactions & flushes 2023-07-23 23:08:46,520 INFO [RS:1;jenkins-hbase4:38881] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-23 23:08:46,520 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690153562651.5f64a7f0784611af52afe26606ce595c. 2023-07-23 23:08:46,520 DEBUG [RS:2;jenkins-hbase4:34863] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:08:46,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690153561769.9badc324f1e32204a0086773ddf03343. 2023-07-23 23:08:46,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690153562651.5f64a7f0784611af52afe26606ce595c. 2023-07-23 23:08:46,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690153561769.9badc324f1e32204a0086773ddf03343. after waiting 0 ms 2023-07-23 23:08:46,521 INFO [RS:1;jenkins-hbase4:38881] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-23 23:08:46,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690153561769.9badc324f1e32204a0086773ddf03343. 2023-07-23 23:08:46,521 DEBUG [RS:1;jenkins-hbase4:38881] regionserver.HRegionServer(1478): Online Regions={9badc324f1e32204a0086773ddf03343=hbase:namespace,,1690153561769.9badc324f1e32204a0086773ddf03343., 1588230740=hbase:meta,,1.1588230740} 2023-07-23 23:08:46,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690153562651.5f64a7f0784611af52afe26606ce595c. after waiting 0 ms 2023-07-23 23:08:46,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 9badc324f1e32204a0086773ddf03343 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-23 23:08:46,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690153562651.5f64a7f0784611af52afe26606ce595c. 2023-07-23 23:08:46,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 5f64a7f0784611af52afe26606ce595c 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-23 23:08:46,521 DEBUG [RS:1;jenkins-hbase4:38881] regionserver.HRegionServer(1504): Waiting on 1588230740, 9badc324f1e32204a0086773ddf03343 2023-07-23 23:08:46,527 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-23 23:08:46,527 INFO [RS:2;jenkins-hbase4:34863] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-23 23:08:46,527 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-23 23:08:46,527 DEBUG [RS:2;jenkins-hbase4:34863] regionserver.HRegionServer(1478): Online Regions={5f64a7f0784611af52afe26606ce595c=hbase:acl,,1690153562651.5f64a7f0784611af52afe26606ce595c.} 2023-07-23 23:08:46,527 DEBUG [RS:2;jenkins-hbase4:34863] regionserver.HRegionServer(1504): Waiting on 5f64a7f0784611af52afe26606ce595c 2023-07-23 23:08:46,528 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-23 23:08:46,528 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-23 23:08:46,528 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-23 23:08:46,528 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-23 23:08:46,534 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-23 23:08:46,545 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-23 23:08:46,569 DEBUG [RS:0;jenkins-hbase4:39259] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/oldWALs 2023-07-23 23:08:46,569 INFO [RS:0;jenkins-hbase4:39259] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39259%2C1690153558742:(num 1690153561104) 2023-07-23 23:08:46,569 DEBUG [RS:0;jenkins-hbase4:39259] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:08:46,569 INFO [RS:0;jenkins-hbase4:39259] regionserver.LeaseManager(133): Closed leases 2023-07-23 23:08:46,582 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-23 23:08:46,587 INFO [RS:0;jenkins-hbase4:39259] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-23 23:08:46,614 INFO [RS:0;jenkins-hbase4:39259] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-23 23:08:46,615 INFO [RS:0;jenkins-hbase4:39259] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-23 23:08:46,615 INFO [RS:0;jenkins-hbase4:39259] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-23 23:08:46,615 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 23:08:46,698 INFO [RS:0;jenkins-hbase4:39259] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39259 2023-07-23 23:08:46,706 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:46,706 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 23:08:46,706 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 23:08:46,713 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/namespace/9badc324f1e32204a0086773ddf03343/.tmp/info/94658bd10b8e46b7b13260c56ffde737 2023-07-23 23:08:46,714 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:46,714 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 23:08:46,715 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39259,1690153558742 2023-07-23 23:08:46,715 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 23:08:46,716 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39259,1690153558742] 2023-07-23 23:08:46,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/acl/5f64a7f0784611af52afe26606ce595c/.tmp/l/d6074fada7b54bf2bb06401169315caf 2023-07-23 23:08:46,719 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39259,1690153558742; numProcessing=1 2023-07-23 23:08:46,722 DEBUG [RS:1;jenkins-hbase4:38881] regionserver.HRegionServer(1504): Waiting on 1588230740, 9badc324f1e32204a0086773ddf03343 2023-07-23 23:08:46,722 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39259,1690153558742 already deleted, retry=false 2023-07-23 23:08:46,722 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39259,1690153558742 expired; onlineServers=2 2023-07-23 23:08:46,728 DEBUG [RS:2;jenkins-hbase4:34863] regionserver.HRegionServer(1504): Waiting on 5f64a7f0784611af52afe26606ce595c 2023-07-23 23:08:46,731 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740/.tmp/info/a481b48ff8e94185939a9a580f55a3cd 2023-07-23 23:08:46,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d6074fada7b54bf2bb06401169315caf 2023-07-23 23:08:46,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/acl/5f64a7f0784611af52afe26606ce595c/.tmp/l/d6074fada7b54bf2bb06401169315caf as hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/acl/5f64a7f0784611af52afe26606ce595c/l/d6074fada7b54bf2bb06401169315caf 2023-07-23 23:08:46,738 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a481b48ff8e94185939a9a580f55a3cd 2023-07-23 23:08:46,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/namespace/9badc324f1e32204a0086773ddf03343/.tmp/info/94658bd10b8e46b7b13260c56ffde737 as hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/namespace/9badc324f1e32204a0086773ddf03343/info/94658bd10b8e46b7b13260c56ffde737 2023-07-23 23:08:46,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d6074fada7b54bf2bb06401169315caf 2023-07-23 23:08:46,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/acl/5f64a7f0784611af52afe26606ce595c/l/d6074fada7b54bf2bb06401169315caf, entries=7, sequenceid=18, filesize=5.2 K 2023-07-23 23:08:46,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 5f64a7f0784611af52afe26606ce595c in 223ms, sequenceid=18, compaction requested=false 2023-07-23 23:08:46,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/namespace/9badc324f1e32204a0086773ddf03343/info/94658bd10b8e46b7b13260c56ffde737, entries=2, sequenceid=6, filesize=4.8 K 2023-07-23 23:08:46,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 9badc324f1e32204a0086773ddf03343 in 258ms, sequenceid=6, compaction requested=false 2023-07-23 23:08:46,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/acl/5f64a7f0784611af52afe26606ce595c/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-23 23:08:46,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:08:46,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1690153562651.5f64a7f0784611af52afe26606ce595c. 2023-07-23 23:08:46,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5f64a7f0784611af52afe26606ce595c: 2023-07-23 23:08:46,811 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1690153562651.5f64a7f0784611af52afe26606ce595c. 2023-07-23 23:08:46,819 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740/.tmp/rep_barrier/993da7a3776a4cd4a172da545f2814ed 2023-07-23 23:08:46,822 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 23:08:46,822 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:39259-0x101946f1b500001, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 23:08:46,822 INFO [RS:0;jenkins-hbase4:39259] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39259,1690153558742; zookeeper connection closed. 2023-07-23 23:08:46,823 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@711b2969] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@711b2969 2023-07-23 23:08:46,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/namespace/9badc324f1e32204a0086773ddf03343/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-23 23:08:46,832 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:08:46,834 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690153561769.9badc324f1e32204a0086773ddf03343. 2023-07-23 23:08:46,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9badc324f1e32204a0086773ddf03343: 2023-07-23 23:08:46,834 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690153561769.9badc324f1e32204a0086773ddf03343. 2023-07-23 23:08:46,838 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 993da7a3776a4cd4a172da545f2814ed 2023-07-23 23:08:46,889 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740/.tmp/table/fcbb09ba40ad41d38a35e97e0b9f5280 2023-07-23 23:08:46,896 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fcbb09ba40ad41d38a35e97e0b9f5280 2023-07-23 23:08:46,897 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740/.tmp/info/a481b48ff8e94185939a9a580f55a3cd as hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740/info/a481b48ff8e94185939a9a580f55a3cd 2023-07-23 23:08:46,904 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a481b48ff8e94185939a9a580f55a3cd 2023-07-23 23:08:46,904 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740/info/a481b48ff8e94185939a9a580f55a3cd, entries=48, sequenceid=131, filesize=10.3 K 2023-07-23 23:08:46,907 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740/.tmp/rep_barrier/993da7a3776a4cd4a172da545f2814ed as hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740/rep_barrier/993da7a3776a4cd4a172da545f2814ed 2023-07-23 23:08:46,909 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-23 23:08:46,909 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-23 23:08:46,915 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 993da7a3776a4cd4a172da545f2814ed 2023-07-23 23:08:46,915 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740/rep_barrier/993da7a3776a4cd4a172da545f2814ed, entries=13, sequenceid=131, filesize=6.4 K 2023-07-23 23:08:46,916 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740/.tmp/table/fcbb09ba40ad41d38a35e97e0b9f5280 as hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740/table/fcbb09ba40ad41d38a35e97e0b9f5280 2023-07-23 23:08:46,922 DEBUG [RS:1;jenkins-hbase4:38881] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-23 23:08:46,923 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fcbb09ba40ad41d38a35e97e0b9f5280 2023-07-23 23:08:46,923 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740/table/fcbb09ba40ad41d38a35e97e0b9f5280, entries=24, sequenceid=131, filesize=6.9 K 2023-07-23 23:08:46,924 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 396ms, sequenceid=131, compaction requested=false 2023-07-23 23:08:46,929 INFO [RS:2;jenkins-hbase4:34863] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34863,1690153558866; all regions closed. 2023-07-23 23:08:46,940 DEBUG [RS:2;jenkins-hbase4:34863] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/oldWALs 2023-07-23 23:08:46,940 INFO [RS:2;jenkins-hbase4:34863] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34863%2C1690153558866:(num 1690153561110) 2023-07-23 23:08:46,940 DEBUG [RS:2;jenkins-hbase4:34863] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:08:46,940 INFO [RS:2;jenkins-hbase4:34863] regionserver.LeaseManager(133): Closed leases 2023-07-23 23:08:46,940 INFO [RS:2;jenkins-hbase4:34863] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-23 23:08:46,941 INFO [RS:2;jenkins-hbase4:34863] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-23 23:08:46,941 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-23 23:08:46,941 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 23:08:46,941 INFO [RS:2;jenkins-hbase4:34863] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-23 23:08:46,941 INFO [RS:2;jenkins-hbase4:34863] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-23 23:08:46,943 INFO [RS:2;jenkins-hbase4:34863] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34863 2023-07-23 23:08:46,943 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:08:46,943 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-23 23:08:46,944 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-23 23:08:46,944 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-23 23:08:46,944 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-23 23:08:46,945 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:08:46,945 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34863,1690153558866 2023-07-23 23:08:46,945 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 23:08:46,947 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34863,1690153558866] 2023-07-23 23:08:46,947 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34863,1690153558866; numProcessing=2 2023-07-23 23:08:46,949 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34863,1690153558866 already deleted, retry=false 2023-07-23 23:08:46,949 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34863,1690153558866 expired; onlineServers=1 2023-07-23 23:08:47,047 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 23:08:47,047 INFO [RS:2;jenkins-hbase4:34863] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34863,1690153558866; zookeeper connection closed. 2023-07-23 23:08:47,047 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:34863-0x101946f1b500003, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 23:08:47,048 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1d508329] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1d508329 2023-07-23 23:08:47,122 INFO [RS:1;jenkins-hbase4:38881] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38881,1690153558819; all regions closed. 2023-07-23 23:08:47,129 DEBUG [RS:1;jenkins-hbase4:38881] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/oldWALs 2023-07-23 23:08:47,129 INFO [RS:1;jenkins-hbase4:38881] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38881%2C1690153558819.meta:.meta(num 1690153561303) 2023-07-23 23:08:47,135 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/WALs/jenkins-hbase4.apache.org,38881,1690153558819/jenkins-hbase4.apache.org%2C38881%2C1690153558819.1690153561103 not finished, retry = 0 2023-07-23 23:08:47,198 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:08:47,198 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-23 23:08:47,198 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:08:47,199 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-23 23:08:47,199 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-23 23:08:47,238 DEBUG [RS:1;jenkins-hbase4:38881] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/oldWALs 2023-07-23 23:08:47,238 INFO [RS:1;jenkins-hbase4:38881] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38881%2C1690153558819:(num 1690153561103) 2023-07-23 23:08:47,238 DEBUG [RS:1;jenkins-hbase4:38881] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:08:47,238 INFO [RS:1;jenkins-hbase4:38881] regionserver.LeaseManager(133): Closed leases 2023-07-23 23:08:47,238 INFO [RS:1;jenkins-hbase4:38881] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-23 23:08:47,239 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 23:08:47,240 INFO [RS:1;jenkins-hbase4:38881] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38881 2023-07-23 23:08:47,241 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-23 23:08:47,241 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38881,1690153558819 2023-07-23 23:08:47,243 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38881,1690153558819] 2023-07-23 23:08:47,243 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38881,1690153558819; numProcessing=3 2023-07-23 23:08:47,245 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38881,1690153558819 already deleted, retry=false 2023-07-23 23:08:47,245 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38881,1690153558819 expired; onlineServers=0 2023-07-23 23:08:47,245 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43049,1690153556996' ***** 2023-07-23 23:08:47,245 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-23 23:08:47,246 DEBUG [M:0;jenkins-hbase4:43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d1650f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-23 23:08:47,246 INFO [M:0;jenkins-hbase4:43049] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43049,1690153556996 2023-07-23 23:08:47,246 INFO [M:0;jenkins-hbase4:43049] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43049,1690153556996; all regions closed. 2023-07-23 23:08:47,246 DEBUG [M:0;jenkins-hbase4:43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-23 23:08:47,246 DEBUG [M:0;jenkins-hbase4:43049] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-23 23:08:47,246 DEBUG [M:0;jenkins-hbase4:43049] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-23 23:08:47,246 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690153560546] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690153560546,5,FailOnTimeoutGroup] 2023-07-23 23:08:47,246 INFO [M:0;jenkins-hbase4:43049] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-23 23:08:47,246 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690153560546] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690153560546,5,FailOnTimeoutGroup] 2023-07-23 23:08:47,247 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-23 23:08:47,247 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-23 23:08:47,247 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-23 23:08:47,246 INFO [M:0;jenkins-hbase4:43049] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-23 23:08:47,248 INFO [M:0;jenkins-hbase4:43049] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-23 23:08:47,248 DEBUG [M:0;jenkins-hbase4:43049] master.HMaster(1512): Stopping service threads 2023-07-23 23:08:47,248 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-23 23:08:47,249 INFO [M:0;jenkins-hbase4:43049] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-23 23:08:47,249 ERROR [M:0;jenkins-hbase4:43049] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-23 23:08:47,250 INFO [M:0;jenkins-hbase4:43049] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-23 23:08:47,250 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-23 23:08:47,253 DEBUG [M:0;jenkins-hbase4:43049] zookeeper.ZKUtil(398): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-23 23:08:47,253 WARN [M:0;jenkins-hbase4:43049] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-23 23:08:47,253 INFO [M:0;jenkins-hbase4:43049] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-23 23:08:47,254 INFO [M:0;jenkins-hbase4:43049] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-23 23:08:47,254 DEBUG [M:0;jenkins-hbase4:43049] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-23 23:08:47,254 INFO [M:0;jenkins-hbase4:43049] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 23:08:47,254 DEBUG [M:0;jenkins-hbase4:43049] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 23:08:47,255 DEBUG [M:0;jenkins-hbase4:43049] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-23 23:08:47,255 DEBUG [M:0;jenkins-hbase4:43049] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 23:08:47,255 INFO [M:0;jenkins-hbase4:43049] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.92 KB heapSize=452.14 KB 2023-07-23 23:08:47,301 INFO [M:0;jenkins-hbase4:43049] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.92 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ac9921f2f34441fdab78e1d2a9aae741 2023-07-23 23:08:47,307 INFO [M:0;jenkins-hbase4:43049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ac9921f2f34441fdab78e1d2a9aae741 2023-07-23 23:08:47,308 DEBUG [M:0;jenkins-hbase4:43049] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ac9921f2f34441fdab78e1d2a9aae741 as hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ac9921f2f34441fdab78e1d2a9aae741 2023-07-23 23:08:47,313 INFO [M:0;jenkins-hbase4:43049] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ac9921f2f34441fdab78e1d2a9aae741 2023-07-23 23:08:47,313 INFO [M:0;jenkins-hbase4:43049] regionserver.HStore(1080): Added hdfs://localhost:40459/user/jenkins/test-data/f1ea86c9-9282-21af-cd89-18c61696ee8f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ac9921f2f34441fdab78e1d2a9aae741, entries=119, sequenceid=899, filesize=28.7 K 2023-07-23 23:08:47,314 INFO [M:0;jenkins-hbase4:43049] regionserver.HRegion(2948): Finished flush of dataSize ~375.92 KB/384939, heapSize ~452.13 KB/462976, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 59ms, sequenceid=899, compaction requested=false 2023-07-23 23:08:47,316 INFO [M:0;jenkins-hbase4:43049] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-23 23:08:47,316 DEBUG [M:0;jenkins-hbase4:43049] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-23 23:08:47,331 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-23 23:08:47,331 INFO [M:0;jenkins-hbase4:43049] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-23 23:08:47,332 INFO [M:0;jenkins-hbase4:43049] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43049 2023-07-23 23:08:47,334 DEBUG [M:0;jenkins-hbase4:43049] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,43049,1690153556996 already deleted, retry=false 2023-07-23 23:08:47,344 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 23:08:47,344 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): regionserver:38881-0x101946f1b500002, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 23:08:47,344 INFO [RS:1;jenkins-hbase4:38881] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38881,1690153558819; zookeeper connection closed. 2023-07-23 23:08:47,346 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@38f227fa] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@38f227fa 2023-07-23 23:08:47,347 INFO [Listener at jenkins-hbase4.apache.org/42491] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-23 23:08:47,438 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 23:08:47,438 INFO [M:0;jenkins-hbase4:43049] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43049,1690153556996; zookeeper connection closed. 2023-07-23 23:08:47,438 DEBUG [Listener at localhost/34569-EventThread] zookeeper.ZKWatcher(600): master:43049-0x101946f1b500000, quorum=127.0.0.1:58893, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-23 23:08:47,440 WARN [Listener at jenkins-hbase4.apache.org/42491] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-23 23:08:47,472 INFO [Listener at jenkins-hbase4.apache.org/42491] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 23:08:47,583 WARN [BP-1201068508-172.31.14.131-1690153552554 heartbeating to localhost/127.0.0.1:40459] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-23 23:08:47,584 WARN [BP-1201068508-172.31.14.131-1690153552554 heartbeating to localhost/127.0.0.1:40459] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1201068508-172.31.14.131-1690153552554 (Datanode Uuid f4d1b812-659a-4696-af8c-bf72bca876e7) service to localhost/127.0.0.1:40459 2023-07-23 23:08:47,587 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/cluster_115860c6-be70-9d94-b4d7-cb76015f80b3/dfs/data/data5/current/BP-1201068508-172.31.14.131-1690153552554] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 23:08:47,587 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/cluster_115860c6-be70-9d94-b4d7-cb76015f80b3/dfs/data/data6/current/BP-1201068508-172.31.14.131-1690153552554] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 23:08:47,590 WARN [Listener at jenkins-hbase4.apache.org/42491] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-23 23:08:47,628 INFO [Listener at jenkins-hbase4.apache.org/42491] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 23:08:47,639 WARN [BP-1201068508-172.31.14.131-1690153552554 heartbeating to localhost/127.0.0.1:40459] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-23 23:08:47,639 WARN [BP-1201068508-172.31.14.131-1690153552554 heartbeating to localhost/127.0.0.1:40459] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1201068508-172.31.14.131-1690153552554 (Datanode Uuid 7eba946d-5bd8-4385-98a8-2b41808e7b9b) service to localhost/127.0.0.1:40459 2023-07-23 23:08:47,640 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/cluster_115860c6-be70-9d94-b4d7-cb76015f80b3/dfs/data/data3/current/BP-1201068508-172.31.14.131-1690153552554] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 23:08:47,640 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/cluster_115860c6-be70-9d94-b4d7-cb76015f80b3/dfs/data/data4/current/BP-1201068508-172.31.14.131-1690153552554] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 23:08:47,645 WARN [Listener at jenkins-hbase4.apache.org/42491] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-23 23:08:47,667 INFO [Listener at jenkins-hbase4.apache.org/42491] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 23:08:47,675 WARN [BP-1201068508-172.31.14.131-1690153552554 heartbeating to localhost/127.0.0.1:40459] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-23 23:08:47,676 WARN [BP-1201068508-172.31.14.131-1690153552554 heartbeating to localhost/127.0.0.1:40459] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1201068508-172.31.14.131-1690153552554 (Datanode Uuid b149ad14-6781-4322-9350-ee16fddd15cb) service to localhost/127.0.0.1:40459 2023-07-23 23:08:47,676 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/cluster_115860c6-be70-9d94-b4d7-cb76015f80b3/dfs/data/data1/current/BP-1201068508-172.31.14.131-1690153552554] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 23:08:47,677 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/8d8cd830-0681-613d-bf85-9929df028df4/cluster_115860c6-be70-9d94-b4d7-cb76015f80b3/dfs/data/data2/current/BP-1201068508-172.31.14.131-1690153552554] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-23 23:08:47,710 INFO [Listener at jenkins-hbase4.apache.org/42491] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-23 23:08:47,842 INFO [Listener at jenkins-hbase4.apache.org/42491] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-23 23:08:47,953 INFO [Listener at jenkins-hbase4.apache.org/42491] hbase.HBaseTestingUtility(1293): Minicluster is down