2023-07-24 12:27:32,185 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-24 12:27:32,441 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce 2023-07-24 12:27:32,441 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-24 12:27:32,441 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-24 12:27:32,476 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-24 12:27:32,719 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-24 12:27:32,719 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/cluster_6ecbaa8a-c107-3c9f-ccef-7cf56d65ce13, deleteOnExit=true 2023-07-24 12:27:32,719 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-24 12:27:32,720 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/test.cache.data in system properties and HBase conf 2023-07-24 12:27:32,720 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/hadoop.tmp.dir in system properties and HBase conf 2023-07-24 12:27:32,721 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/hadoop.log.dir in system properties and HBase conf 2023-07-24 12:27:32,721 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-24 12:27:32,722 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-24 12:27:32,722 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-24 12:27:33,041 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-24 12:27:33,047 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-24 12:27:33,047 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-24 12:27:33,048 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-24 12:27:33,048 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 12:27:33,049 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-24 12:27:33,049 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-24 12:27:33,050 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 12:27:33,050 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 12:27:33,051 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-24 12:27:33,051 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/nfs.dump.dir in system properties and HBase conf 2023-07-24 12:27:33,052 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/java.io.tmpdir in system properties and HBase conf 2023-07-24 12:27:33,052 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 12:27:33,053 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-24 12:27:33,053 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-24 12:27:33,664 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-24 12:27:33,668 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-24 12:27:33,951 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-24 12:27:34,126 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-24 12:27:34,143 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 12:27:34,179 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 12:27:34,210 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/java.io.tmpdir/Jetty_localhost_38665_hdfs____3c7hy2/webapp 2023-07-24 12:27:34,366 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38665 2023-07-24 12:27:34,413 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-24 12:27:34,413 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-24 12:27:34,977 WARN [Listener at localhost/42387] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 12:27:35,065 WARN [Listener at localhost/42387] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 12:27:35,089 WARN [Listener at localhost/42387] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 12:27:35,097 INFO [Listener at localhost/42387] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 12:27:35,105 INFO [Listener at localhost/42387] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/java.io.tmpdir/Jetty_localhost_39297_datanode____.2iqzqn/webapp 2023-07-24 12:27:35,286 INFO [Listener at localhost/42387] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39297 2023-07-24 12:27:35,801 WARN [Listener at localhost/35925] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 12:27:35,839 WARN [Listener at localhost/35925] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 12:27:35,847 WARN [Listener at localhost/35925] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 12:27:35,848 INFO [Listener at localhost/35925] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 12:27:35,857 INFO [Listener at localhost/35925] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/java.io.tmpdir/Jetty_localhost_35747_datanode____.fdhd4x/webapp 2023-07-24 12:27:35,984 INFO [Listener at localhost/35925] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35747 2023-07-24 12:27:36,011 WARN [Listener at localhost/39575] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 12:27:36,070 WARN [Listener at localhost/39575] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 12:27:36,077 WARN [Listener at localhost/39575] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 12:27:36,081 INFO [Listener at localhost/39575] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 12:27:36,093 INFO [Listener at localhost/39575] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/java.io.tmpdir/Jetty_localhost_40407_datanode____7vcnmu/webapp 2023-07-24 12:27:36,270 INFO [Listener at localhost/39575] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40407 2023-07-24 12:27:36,314 WARN [Listener at localhost/36245] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 12:27:36,440 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7495e5f3e9d02968: Processing first storage report for DS-6f247f65-0d00-472a-bb0b-558b14302ed8 from datanode 19d82370-3e19-4894-8366-cabf66b42541 2023-07-24 12:27:36,441 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7495e5f3e9d02968: from storage DS-6f247f65-0d00-472a-bb0b-558b14302ed8 node DatanodeRegistration(127.0.0.1:45287, datanodeUuid=19d82370-3e19-4894-8366-cabf66b42541, infoPort=37203, infoSecurePort=0, ipcPort=39575, storageInfo=lv=-57;cid=testClusterID;nsid=1599103954;c=1690201653738), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-24 12:27:36,442 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8f95e4ed2b996f76: Processing first storage report for DS-21f48b93-604b-4af4-9812-20eaca723149 from datanode 23f2ea4b-c4a7-41c7-aadd-6ec06db9adb1 2023-07-24 12:27:36,442 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8f95e4ed2b996f76: from storage DS-21f48b93-604b-4af4-9812-20eaca723149 node DatanodeRegistration(127.0.0.1:43797, datanodeUuid=23f2ea4b-c4a7-41c7-aadd-6ec06db9adb1, infoPort=37385, infoSecurePort=0, ipcPort=35925, storageInfo=lv=-57;cid=testClusterID;nsid=1599103954;c=1690201653738), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 12:27:36,442 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7495e5f3e9d02968: Processing first storage report for DS-d390de6d-284e-4449-a159-0a0bc913d2c5 from datanode 19d82370-3e19-4894-8366-cabf66b42541 2023-07-24 12:27:36,442 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7495e5f3e9d02968: from storage DS-d390de6d-284e-4449-a159-0a0bc913d2c5 node DatanodeRegistration(127.0.0.1:45287, datanodeUuid=19d82370-3e19-4894-8366-cabf66b42541, infoPort=37203, infoSecurePort=0, ipcPort=39575, storageInfo=lv=-57;cid=testClusterID;nsid=1599103954;c=1690201653738), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 12:27:36,446 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x8f95e4ed2b996f76: Processing first storage report for DS-ba72196d-fddf-4fc5-afd2-1df482f94792 from datanode 23f2ea4b-c4a7-41c7-aadd-6ec06db9adb1 2023-07-24 12:27:36,447 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x8f95e4ed2b996f76: from storage DS-ba72196d-fddf-4fc5-afd2-1df482f94792 node DatanodeRegistration(127.0.0.1:43797, datanodeUuid=23f2ea4b-c4a7-41c7-aadd-6ec06db9adb1, infoPort=37385, infoSecurePort=0, ipcPort=35925, storageInfo=lv=-57;cid=testClusterID;nsid=1599103954;c=1690201653738), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 12:27:36,541 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4b3896c070ffd97c: Processing first storage report for DS-351b676a-cf55-41c3-9aff-33876010284b from datanode a24b1a35-a6c9-45ab-9b01-0351356200d8 2023-07-24 12:27:36,541 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4b3896c070ffd97c: from storage DS-351b676a-cf55-41c3-9aff-33876010284b node DatanodeRegistration(127.0.0.1:37201, datanodeUuid=a24b1a35-a6c9-45ab-9b01-0351356200d8, infoPort=38563, infoSecurePort=0, ipcPort=36245, storageInfo=lv=-57;cid=testClusterID;nsid=1599103954;c=1690201653738), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 12:27:36,541 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4b3896c070ffd97c: Processing first storage report for DS-46ae2aaa-1871-4b18-803f-59caec01c7c0 from datanode a24b1a35-a6c9-45ab-9b01-0351356200d8 2023-07-24 12:27:36,541 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4b3896c070ffd97c: from storage DS-46ae2aaa-1871-4b18-803f-59caec01c7c0 node DatanodeRegistration(127.0.0.1:37201, datanodeUuid=a24b1a35-a6c9-45ab-9b01-0351356200d8, infoPort=38563, infoSecurePort=0, ipcPort=36245, storageInfo=lv=-57;cid=testClusterID;nsid=1599103954;c=1690201653738), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 12:27:36,815 DEBUG [Listener at localhost/36245] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce 2023-07-24 12:27:36,926 INFO [Listener at localhost/36245] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/cluster_6ecbaa8a-c107-3c9f-ccef-7cf56d65ce13/zookeeper_0, clientPort=49553, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/cluster_6ecbaa8a-c107-3c9f-ccef-7cf56d65ce13/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/cluster_6ecbaa8a-c107-3c9f-ccef-7cf56d65ce13/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-24 12:27:36,947 INFO [Listener at localhost/36245] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=49553 2023-07-24 12:27:36,959 INFO [Listener at localhost/36245] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 12:27:36,962 INFO [Listener at localhost/36245] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 12:27:37,638 INFO [Listener at localhost/36245] util.FSUtils(471): Created version file at hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa with version=8 2023-07-24 12:27:37,638 INFO [Listener at localhost/36245] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/hbase-staging 2023-07-24 12:27:38,003 INFO [Listener at localhost/36245] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-24 12:27:38,594 INFO [Listener at localhost/36245] client.ConnectionUtils(127): master/jenkins-hbase6:0 server-side Connection retries=45 2023-07-24 12:27:38,635 INFO [Listener at localhost/36245] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 12:27:38,636 INFO [Listener at localhost/36245] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 12:27:38,636 INFO [Listener at localhost/36245] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 12:27:38,636 INFO [Listener at localhost/36245] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 12:27:38,636 INFO [Listener at localhost/36245] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 12:27:38,804 INFO [Listener at localhost/36245] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 12:27:38,884 DEBUG [Listener at localhost/36245] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-24 12:27:39,001 INFO [Listener at localhost/36245] ipc.NettyRpcServer(120): Bind to /172.31.2.20:38215 2023-07-24 12:27:39,015 INFO [Listener at localhost/36245] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 12:27:39,017 INFO [Listener at localhost/36245] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 12:27:39,044 INFO [Listener at localhost/36245] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38215 connecting to ZooKeeper ensemble=127.0.0.1:49553 2023-07-24 12:27:39,092 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:382150x0, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 12:27:39,096 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38215-0x100bed88b280000 connected 2023-07-24 12:27:39,132 DEBUG [Listener at localhost/36245] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 12:27:39,133 DEBUG [Listener at localhost/36245] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 12:27:39,145 DEBUG [Listener at localhost/36245] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 12:27:39,155 DEBUG [Listener at localhost/36245] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38215 2023-07-24 12:27:39,156 DEBUG [Listener at localhost/36245] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38215 2023-07-24 12:27:39,156 DEBUG [Listener at localhost/36245] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38215 2023-07-24 12:27:39,159 DEBUG [Listener at localhost/36245] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38215 2023-07-24 12:27:39,163 DEBUG [Listener at localhost/36245] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38215 2023-07-24 12:27:39,171 INFO [Listener at localhost/36245] master.HMaster(444): hbase.rootdir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa, hbase.cluster.distributed=false 2023-07-24 12:27:39,254 INFO [Listener at localhost/36245] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-07-24 12:27:39,255 INFO [Listener at localhost/36245] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 12:27:39,255 INFO [Listener at localhost/36245] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 12:27:39,255 INFO [Listener at localhost/36245] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 12:27:39,255 INFO [Listener at localhost/36245] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 12:27:39,255 INFO [Listener at localhost/36245] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 12:27:39,262 INFO [Listener at localhost/36245] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 12:27:39,267 INFO [Listener at localhost/36245] ipc.NettyRpcServer(120): Bind to /172.31.2.20:44517 2023-07-24 12:27:39,270 INFO [Listener at localhost/36245] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 12:27:39,281 INFO [Listener at localhost/36245] mob.MobFileCache(124): MobFileCache disabled 2023-07-24 12:27:39,283 INFO [Listener at localhost/36245] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 12:27:39,285 INFO [Listener at localhost/36245] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 12:27:39,288 INFO [Listener at localhost/36245] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44517 connecting to ZooKeeper ensemble=127.0.0.1:49553 2023-07-24 12:27:39,296 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:445170x0, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 12:27:39,297 DEBUG [Listener at localhost/36245] zookeeper.ZKUtil(164): regionserver:445170x0, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 12:27:39,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44517-0x100bed88b280001 connected 2023-07-24 12:27:39,303 DEBUG [Listener at localhost/36245] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 12:27:39,304 DEBUG [Listener at localhost/36245] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 12:27:39,311 DEBUG [Listener at localhost/36245] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44517 2023-07-24 12:27:39,312 DEBUG [Listener at localhost/36245] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44517 2023-07-24 12:27:39,312 DEBUG [Listener at localhost/36245] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44517 2023-07-24 12:27:39,313 DEBUG [Listener at localhost/36245] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44517 2023-07-24 12:27:39,315 DEBUG [Listener at localhost/36245] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44517 2023-07-24 12:27:39,332 INFO [Listener at localhost/36245] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-07-24 12:27:39,332 INFO [Listener at localhost/36245] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 12:27:39,333 INFO [Listener at localhost/36245] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 12:27:39,333 INFO [Listener at localhost/36245] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 12:27:39,333 INFO [Listener at localhost/36245] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 12:27:39,334 INFO [Listener at localhost/36245] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 12:27:39,334 INFO [Listener at localhost/36245] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 12:27:39,339 INFO [Listener at localhost/36245] ipc.NettyRpcServer(120): Bind to /172.31.2.20:44275 2023-07-24 12:27:39,339 INFO [Listener at localhost/36245] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 12:27:39,340 INFO [Listener at localhost/36245] mob.MobFileCache(124): MobFileCache disabled 2023-07-24 12:27:39,341 INFO [Listener at localhost/36245] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 12:27:39,345 INFO [Listener at localhost/36245] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 12:27:39,354 INFO [Listener at localhost/36245] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44275 connecting to ZooKeeper ensemble=127.0.0.1:49553 2023-07-24 12:27:39,359 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:442750x0, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 12:27:39,361 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44275-0x100bed88b280002 connected 2023-07-24 12:27:39,361 DEBUG [Listener at localhost/36245] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 12:27:39,364 DEBUG [Listener at localhost/36245] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 12:27:39,367 DEBUG [Listener at localhost/36245] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 12:27:39,372 DEBUG [Listener at localhost/36245] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44275 2023-07-24 12:27:39,372 DEBUG [Listener at localhost/36245] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44275 2023-07-24 12:27:39,375 DEBUG [Listener at localhost/36245] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44275 2023-07-24 12:27:39,378 DEBUG [Listener at localhost/36245] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44275 2023-07-24 12:27:39,379 DEBUG [Listener at localhost/36245] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44275 2023-07-24 12:27:39,396 INFO [Listener at localhost/36245] client.ConnectionUtils(127): regionserver/jenkins-hbase6:0 server-side Connection retries=45 2023-07-24 12:27:39,397 INFO [Listener at localhost/36245] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 12:27:39,397 INFO [Listener at localhost/36245] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 12:27:39,397 INFO [Listener at localhost/36245] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 12:27:39,397 INFO [Listener at localhost/36245] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 12:27:39,398 INFO [Listener at localhost/36245] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 12:27:39,398 INFO [Listener at localhost/36245] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 12:27:39,400 INFO [Listener at localhost/36245] ipc.NettyRpcServer(120): Bind to /172.31.2.20:36595 2023-07-24 12:27:39,400 INFO [Listener at localhost/36245] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 12:27:39,402 INFO [Listener at localhost/36245] mob.MobFileCache(124): MobFileCache disabled 2023-07-24 12:27:39,404 INFO [Listener at localhost/36245] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 12:27:39,406 INFO [Listener at localhost/36245] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 12:27:39,408 INFO [Listener at localhost/36245] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36595 connecting to ZooKeeper ensemble=127.0.0.1:49553 2023-07-24 12:27:39,415 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:365950x0, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 12:27:39,416 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36595-0x100bed88b280003 connected 2023-07-24 12:27:39,416 DEBUG [Listener at localhost/36245] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 12:27:39,417 DEBUG [Listener at localhost/36245] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 12:27:39,418 DEBUG [Listener at localhost/36245] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 12:27:39,419 DEBUG [Listener at localhost/36245] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36595 2023-07-24 12:27:39,420 DEBUG [Listener at localhost/36245] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36595 2023-07-24 12:27:39,420 DEBUG [Listener at localhost/36245] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36595 2023-07-24 12:27:39,423 DEBUG [Listener at localhost/36245] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36595 2023-07-24 12:27:39,425 DEBUG [Listener at localhost/36245] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36595 2023-07-24 12:27:39,430 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase6.apache.org,38215,1690201657817 2023-07-24 12:27:39,441 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-24 12:27:39,444 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase6.apache.org,38215,1690201657817 2023-07-24 12:27:39,469 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 12:27:39,469 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 12:27:39,471 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 12:27:39,470 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 12:27:39,471 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 12:27:39,474 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-24 12:27:39,476 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase6.apache.org,38215,1690201657817 from backup master directory 2023-07-24 12:27:39,476 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-24 12:27:39,481 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase6.apache.org,38215,1690201657817 2023-07-24 12:27:39,481 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-24 12:27:39,482 WARN [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 12:27:39,482 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase6.apache.org,38215,1690201657817 2023-07-24 12:27:39,485 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-24 12:27:39,487 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-24 12:27:39,611 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/hbase.id with ID: 02d94aec-1c97-47a0-b916-caa81dceb950 2023-07-24 12:27:39,654 INFO [master/jenkins-hbase6:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 12:27:39,672 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 12:27:39,746 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x189f9632 to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:27:39,786 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7cf2659c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:27:39,811 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 12:27:39,813 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-24 12:27:39,833 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-24 12:27:39,834 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-24 12:27:39,836 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-24 12:27:39,841 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-24 12:27:39,843 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 12:27:39,888 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/MasterData/data/master/store-tmp 2023-07-24 12:27:39,950 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:27:39,950 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-24 12:27:39,950 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 12:27:39,950 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 12:27:39,951 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-24 12:27:39,951 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 12:27:39,951 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 12:27:39,951 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 12:27:39,953 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/MasterData/WALs/jenkins-hbase6.apache.org,38215,1690201657817 2023-07-24 12:27:39,980 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C38215%2C1690201657817, suffix=, logDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/MasterData/WALs/jenkins-hbase6.apache.org,38215,1690201657817, archiveDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/MasterData/oldWALs, maxLogs=10 2023-07-24 12:27:40,082 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43797,DS-21f48b93-604b-4af4-9812-20eaca723149,DISK] 2023-07-24 12:27:40,082 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37201,DS-351b676a-cf55-41c3-9aff-33876010284b,DISK] 2023-07-24 12:27:40,082 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45287,DS-6f247f65-0d00-472a-bb0b-558b14302ed8,DISK] 2023-07-24 12:27:40,094 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-24 12:27:40,193 INFO [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/MasterData/WALs/jenkins-hbase6.apache.org,38215,1690201657817/jenkins-hbase6.apache.org%2C38215%2C1690201657817.1690201659995 2023-07-24 12:27:40,195 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37201,DS-351b676a-cf55-41c3-9aff-33876010284b,DISK], DatanodeInfoWithStorage[127.0.0.1:45287,DS-6f247f65-0d00-472a-bb0b-558b14302ed8,DISK], DatanodeInfoWithStorage[127.0.0.1:43797,DS-21f48b93-604b-4af4-9812-20eaca723149,DISK]] 2023-07-24 12:27:40,196 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-24 12:27:40,197 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:27:40,201 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 12:27:40,202 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 12:27:40,290 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-24 12:27:40,298 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-24 12:27:40,333 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-24 12:27:40,347 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 12:27:40,354 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-24 12:27:40,356 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-24 12:27:40,373 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 12:27:40,381 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 12:27:40,382 INFO [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73668554, jitterRate=0.09774699807167053}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 12:27:40,382 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 12:27:40,383 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-24 12:27:40,404 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-24 12:27:40,405 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-24 12:27:40,407 INFO [master/jenkins-hbase6:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-24 12:27:40,409 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-24 12:27:40,458 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 49 msec 2023-07-24 12:27:40,459 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-24 12:27:40,500 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-24 12:27:40,506 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-24 12:27:40,535 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-24 12:27:40,541 INFO [master/jenkins-hbase6:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-24 12:27:40,542 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-24 12:27:40,550 INFO [master/jenkins-hbase6:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-24 12:27:40,555 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-24 12:27:40,558 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 12:27:40,560 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-24 12:27:40,561 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-24 12:27:40,579 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-24 12:27:40,586 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 12:27:40,587 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 12:27:40,587 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 12:27:40,587 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 12:27:40,587 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 12:27:40,590 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase6.apache.org,38215,1690201657817, sessionid=0x100bed88b280000, setting cluster-up flag (Was=false) 2023-07-24 12:27:40,633 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 12:27:40,645 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-24 12:27:40,646 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,38215,1690201657817 2023-07-24 12:27:40,654 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 12:27:40,663 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-24 12:27:40,665 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase6.apache.org,38215,1690201657817 2023-07-24 12:27:40,668 WARN [master/jenkins-hbase6:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp 2023-07-24 12:27:40,736 INFO [RS:1;jenkins-hbase6:44275] regionserver.HRegionServer(951): ClusterId : 02d94aec-1c97-47a0-b916-caa81dceb950 2023-07-24 12:27:40,736 INFO [RS:0;jenkins-hbase6:44517] regionserver.HRegionServer(951): ClusterId : 02d94aec-1c97-47a0-b916-caa81dceb950 2023-07-24 12:27:40,743 INFO [RS:2;jenkins-hbase6:36595] regionserver.HRegionServer(951): ClusterId : 02d94aec-1c97-47a0-b916-caa81dceb950 2023-07-24 12:27:40,746 DEBUG [RS:2;jenkins-hbase6:36595] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 12:27:40,746 DEBUG [RS:1;jenkins-hbase6:44275] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 12:27:40,746 DEBUG [RS:0;jenkins-hbase6:44517] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 12:27:40,755 DEBUG [RS:2;jenkins-hbase6:36595] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 12:27:40,755 DEBUG [RS:2;jenkins-hbase6:36595] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 12:27:40,756 DEBUG [RS:1;jenkins-hbase6:44275] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 12:27:40,756 DEBUG [RS:1;jenkins-hbase6:44275] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 12:27:40,757 DEBUG [RS:0;jenkins-hbase6:44517] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 12:27:40,757 DEBUG [RS:0;jenkins-hbase6:44517] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 12:27:40,759 DEBUG [RS:2;jenkins-hbase6:36595] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 12:27:40,761 DEBUG [RS:2;jenkins-hbase6:36595] zookeeper.ReadOnlyZKClient(139): Connect 0x2a0eda72 to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:27:40,761 DEBUG [RS:0;jenkins-hbase6:44517] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 12:27:40,762 DEBUG [RS:1;jenkins-hbase6:44275] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 12:27:40,768 DEBUG [RS:0;jenkins-hbase6:44517] zookeeper.ReadOnlyZKClient(139): Connect 0x599ea369 to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:27:40,770 DEBUG [RS:1;jenkins-hbase6:44275] zookeeper.ReadOnlyZKClient(139): Connect 0x25160707 to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:27:40,801 DEBUG [RS:2;jenkins-hbase6:36595] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13fb3429, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:27:40,802 DEBUG [RS:2;jenkins-hbase6:36595] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71a5a8b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-07-24 12:27:40,805 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-24 12:27:40,810 INFO [master/jenkins-hbase6:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 12:27:40,810 INFO [master/jenkins-hbase6:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-24 12:27:40,835 DEBUG [RS:0;jenkins-hbase6:44517] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c9c363e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:27:40,835 DEBUG [RS:0;jenkins-hbase6:44517] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@79df03b4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-07-24 12:27:40,835 DEBUG [RS:1;jenkins-hbase6:44275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b4e9752, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:27:40,837 DEBUG [RS:1;jenkins-hbase6:44275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@387a032, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-07-24 12:27:40,849 DEBUG [RS:1;jenkins-hbase6:44275] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase6:44275 2023-07-24 12:27:40,851 DEBUG [RS:0;jenkins-hbase6:44517] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase6:44517 2023-07-24 12:27:40,855 DEBUG [RS:2;jenkins-hbase6:36595] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase6:36595 2023-07-24 12:27:40,858 INFO [RS:0;jenkins-hbase6:44517] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 12:27:40,859 INFO [RS:2;jenkins-hbase6:36595] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 12:27:40,859 INFO [RS:0;jenkins-hbase6:44517] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 12:27:40,858 INFO [RS:1;jenkins-hbase6:44275] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 12:27:40,859 INFO [RS:2;jenkins-hbase6:36595] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 12:27:40,859 DEBUG [RS:0;jenkins-hbase6:44517] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 12:27:40,859 INFO [RS:1;jenkins-hbase6:44275] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 12:27:40,860 INFO [RS:0;jenkins-hbase6:44517] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 12:27:40,860 DEBUG [RS:1;jenkins-hbase6:44275] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 12:27:40,859 DEBUG [RS:2;jenkins-hbase6:36595] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 12:27:40,861 INFO [RS:2;jenkins-hbase6:36595] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 12:27:40,861 DEBUG [RS:2;jenkins-hbase6:36595] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 12:27:40,860 DEBUG [RS:0;jenkins-hbase6:44517] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 12:27:40,863 INFO [RS:1;jenkins-hbase6:44275] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 12:27:40,863 DEBUG [RS:1;jenkins-hbase6:44275] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 12:27:40,864 INFO [RS:2;jenkins-hbase6:36595] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase6.apache.org,38215,1690201657817 with isa=jenkins-hbase6.apache.org/172.31.2.20:36595, startcode=1690201659396 2023-07-24 12:27:40,864 INFO [RS:0;jenkins-hbase6:44517] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase6.apache.org,38215,1690201657817 with isa=jenkins-hbase6.apache.org/172.31.2.20:44517, startcode=1690201659253 2023-07-24 12:27:40,864 INFO [RS:1;jenkins-hbase6:44275] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase6.apache.org,38215,1690201657817 with isa=jenkins-hbase6.apache.org/172.31.2.20:44275, startcode=1690201659331 2023-07-24 12:27:40,886 DEBUG [RS:1;jenkins-hbase6:44275] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 12:27:40,886 DEBUG [RS:0;jenkins-hbase6:44517] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 12:27:40,886 DEBUG [RS:2;jenkins-hbase6:36595] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 12:27:40,950 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-24 12:27:40,961 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-07-24 12:27:40,961 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-07-24 12:27:40,962 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-07-24 12:27:40,962 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=5, maxPoolSize=5 2023-07-24 12:27:40,962 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase6:0, corePoolSize=10, maxPoolSize=10 2023-07-24 12:27:40,962 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:40,962 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-07-24 12:27:40,962 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:40,965 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:55099, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 12:27:40,965 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690201690965 2023-07-24 12:27:40,967 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-24 12:27:40,965 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:57067, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 12:27:40,965 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:51025, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 12:27:40,977 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38215] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 12:27:40,982 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-24 12:27:40,988 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38215] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 12:27:40,991 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38215] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 12:27:40,994 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-24 12:27:40,995 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-24 12:27:40,996 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-24 12:27:40,996 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-24 12:27:40,998 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:41,000 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-24 12:27:41,000 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-24 12:27:41,001 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-24 12:27:41,003 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-24 12:27:41,003 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-24 12:27:41,006 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-24 12:27:41,007 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 12:27:41,007 INFO [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-24 12:27:41,014 DEBUG [RS:2;jenkins-hbase6:36595] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 12:27:41,016 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1690201661009,5,FailOnTimeoutGroup] 2023-07-24 12:27:41,014 DEBUG [RS:0;jenkins-hbase6:44517] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 12:27:41,017 WARN [RS:0;jenkins-hbase6:44517] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 12:27:41,014 DEBUG [RS:1;jenkins-hbase6:44275] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 12:27:41,016 WARN [RS:2;jenkins-hbase6:36595] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 12:27:41,017 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1690201661016,5,FailOnTimeoutGroup] 2023-07-24 12:27:41,017 WARN [RS:1;jenkins-hbase6:44275] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 12:27:41,017 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:41,018 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-24 12:27:41,020 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:41,020 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:41,085 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-24 12:27:41,086 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-24 12:27:41,087 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa 2023-07-24 12:27:41,118 INFO [RS:2;jenkins-hbase6:36595] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase6.apache.org,38215,1690201657817 with isa=jenkins-hbase6.apache.org/172.31.2.20:36595, startcode=1690201659396 2023-07-24 12:27:41,118 INFO [RS:1;jenkins-hbase6:44275] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase6.apache.org,38215,1690201657817 with isa=jenkins-hbase6.apache.org/172.31.2.20:44275, startcode=1690201659331 2023-07-24 12:27:41,118 INFO [RS:0;jenkins-hbase6:44517] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase6.apache.org,38215,1690201657817 with isa=jenkins-hbase6.apache.org/172.31.2.20:44517, startcode=1690201659253 2023-07-24 12:27:41,156 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38215] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:41,166 DEBUG [RS:1;jenkins-hbase6:44275] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa 2023-07-24 12:27:41,166 DEBUG [RS:1;jenkins-hbase6:44275] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42387 2023-07-24 12:27:41,166 DEBUG [RS:1;jenkins-hbase6:44275] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 12:27:41,169 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38215] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:41,176 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38215] master.ServerManager(394): Registering regionserver=jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:41,180 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 12:27:41,181 DEBUG [RS:0;jenkins-hbase6:44517] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa 2023-07-24 12:27:41,181 DEBUG [RS:0;jenkins-hbase6:44517] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42387 2023-07-24 12:27:41,181 DEBUG [RS:0;jenkins-hbase6:44517] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 12:27:41,181 DEBUG [RS:1;jenkins-hbase6:44275] zookeeper.ZKUtil(162): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:41,182 DEBUG [RS:2;jenkins-hbase6:36595] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa 2023-07-24 12:27:41,183 DEBUG [RS:2;jenkins-hbase6:36595] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42387 2023-07-24 12:27:41,184 DEBUG [RS:2;jenkins-hbase6:36595] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 12:27:41,182 WARN [RS:1;jenkins-hbase6:44275] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 12:27:41,184 INFO [RS:1;jenkins-hbase6:44275] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 12:27:41,184 DEBUG [RS:1;jenkins-hbase6:44275] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/WALs/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:41,199 DEBUG [RS:0;jenkins-hbase6:44517] zookeeper.ZKUtil(162): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:41,200 DEBUG [RS:2;jenkins-hbase6:36595] zookeeper.ZKUtil(162): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:41,201 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,44517,1690201659253] 2023-07-24 12:27:41,201 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,44275,1690201659331] 2023-07-24 12:27:41,201 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase6.apache.org,36595,1690201659396] 2023-07-24 12:27:41,199 WARN [RS:0;jenkins-hbase6:44517] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 12:27:41,200 WARN [RS:2;jenkins-hbase6:36595] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 12:27:41,204 INFO [RS:2;jenkins-hbase6:36595] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 12:27:41,205 DEBUG [RS:2;jenkins-hbase6:36595] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/WALs/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:41,204 INFO [RS:0;jenkins-hbase6:44517] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 12:27:41,206 DEBUG [RS:0;jenkins-hbase6:44517] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/WALs/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:41,223 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:27:41,226 DEBUG [RS:1;jenkins-hbase6:44275] zookeeper.ZKUtil(162): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:41,231 DEBUG [RS:1;jenkins-hbase6:44275] zookeeper.ZKUtil(162): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:41,232 DEBUG [RS:1;jenkins-hbase6:44275] zookeeper.ZKUtil(162): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:41,232 DEBUG [RS:2;jenkins-hbase6:36595] zookeeper.ZKUtil(162): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:41,233 DEBUG [RS:2;jenkins-hbase6:36595] zookeeper.ZKUtil(162): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:41,233 DEBUG [RS:2;jenkins-hbase6:36595] zookeeper.ZKUtil(162): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:41,234 DEBUG [RS:0;jenkins-hbase6:44517] zookeeper.ZKUtil(162): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:41,234 DEBUG [RS:0;jenkins-hbase6:44517] zookeeper.ZKUtil(162): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:41,235 DEBUG [RS:0;jenkins-hbase6:44517] zookeeper.ZKUtil(162): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:41,239 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-24 12:27:41,249 DEBUG [RS:1;jenkins-hbase6:44275] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 12:27:41,250 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740/info 2023-07-24 12:27:41,251 DEBUG [RS:2;jenkins-hbase6:36595] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 12:27:41,251 DEBUG [RS:0;jenkins-hbase6:44517] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 12:27:41,251 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-24 12:27:41,252 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 12:27:41,253 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-24 12:27:41,256 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740/rep_barrier 2023-07-24 12:27:41,257 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-24 12:27:41,258 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 12:27:41,258 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-24 12:27:41,261 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740/table 2023-07-24 12:27:41,262 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-24 12:27:41,262 INFO [RS:1;jenkins-hbase6:44275] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 12:27:41,262 INFO [RS:2;jenkins-hbase6:36595] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 12:27:41,262 INFO [RS:0;jenkins-hbase6:44517] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 12:27:41,265 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 12:27:41,267 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740 2023-07-24 12:27:41,268 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740 2023-07-24 12:27:41,274 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-24 12:27:41,280 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-24 12:27:41,288 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 12:27:41,289 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63300918, jitterRate=-0.05674281716346741}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-24 12:27:41,289 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-24 12:27:41,290 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-24 12:27:41,290 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-24 12:27:41,290 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-24 12:27:41,290 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-24 12:27:41,290 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-24 12:27:41,291 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-24 12:27:41,292 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-24 12:27:41,297 INFO [RS:2;jenkins-hbase6:36595] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 12:27:41,299 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-24 12:27:41,300 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-24 12:27:41,301 INFO [RS:1;jenkins-hbase6:44275] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 12:27:41,308 INFO [RS:0;jenkins-hbase6:44517] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 12:27:41,321 INFO [RS:2;jenkins-hbase6:36595] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 12:27:41,321 INFO [RS:2;jenkins-hbase6:36595] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:41,322 INFO [RS:0;jenkins-hbase6:44517] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 12:27:41,323 INFO [RS:2;jenkins-hbase6:36595] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 12:27:41,322 INFO [RS:1;jenkins-hbase6:44275] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 12:27:41,322 INFO [RS:0;jenkins-hbase6:44517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:41,330 INFO [RS:1;jenkins-hbase6:44275] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:41,331 INFO [RS:0;jenkins-hbase6:44517] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 12:27:41,332 INFO [RS:1;jenkins-hbase6:44275] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 12:27:41,337 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-24 12:27:41,341 INFO [RS:2;jenkins-hbase6:36595] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:41,341 INFO [RS:0;jenkins-hbase6:44517] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:41,341 INFO [RS:1;jenkins-hbase6:44275] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:41,342 DEBUG [RS:0;jenkins-hbase6:44517] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,342 DEBUG [RS:1;jenkins-hbase6:44275] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,342 DEBUG [RS:0;jenkins-hbase6:44517] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,343 DEBUG [RS:1;jenkins-hbase6:44275] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,343 DEBUG [RS:0;jenkins-hbase6:44517] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,343 DEBUG [RS:1;jenkins-hbase6:44275] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,343 DEBUG [RS:0;jenkins-hbase6:44517] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,343 DEBUG [RS:1;jenkins-hbase6:44275] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,343 DEBUG [RS:0;jenkins-hbase6:44517] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,343 DEBUG [RS:1;jenkins-hbase6:44275] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,343 DEBUG [RS:0;jenkins-hbase6:44517] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-07-24 12:27:41,343 DEBUG [RS:0;jenkins-hbase6:44517] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,344 DEBUG [RS:0;jenkins-hbase6:44517] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,344 DEBUG [RS:0;jenkins-hbase6:44517] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,344 DEBUG [RS:0;jenkins-hbase6:44517] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,343 DEBUG [RS:1;jenkins-hbase6:44275] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-07-24 12:27:41,351 DEBUG [RS:1;jenkins-hbase6:44275] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,351 DEBUG [RS:1;jenkins-hbase6:44275] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,352 DEBUG [RS:1;jenkins-hbase6:44275] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,352 DEBUG [RS:1;jenkins-hbase6:44275] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,368 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-24 12:27:41,372 INFO [RS:0;jenkins-hbase6:44517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:41,372 DEBUG [RS:2;jenkins-hbase6:36595] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,372 INFO [RS:0;jenkins-hbase6:44517] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:41,372 DEBUG [RS:2;jenkins-hbase6:36595] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,372 INFO [RS:0;jenkins-hbase6:44517] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:41,372 DEBUG [RS:2;jenkins-hbase6:36595] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,372 DEBUG [RS:2;jenkins-hbase6:36595] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,372 DEBUG [RS:2;jenkins-hbase6:36595] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,372 DEBUG [RS:2;jenkins-hbase6:36595] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase6:0, corePoolSize=2, maxPoolSize=2 2023-07-24 12:27:41,373 DEBUG [RS:2;jenkins-hbase6:36595] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,373 DEBUG [RS:2;jenkins-hbase6:36595] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,373 DEBUG [RS:2;jenkins-hbase6:36595] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,373 DEBUG [RS:2;jenkins-hbase6:36595] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase6:0, corePoolSize=1, maxPoolSize=1 2023-07-24 12:27:41,379 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-24 12:27:41,380 INFO [RS:2;jenkins-hbase6:36595] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:41,380 INFO [RS:2;jenkins-hbase6:36595] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:41,380 INFO [RS:2;jenkins-hbase6:36595] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:41,394 INFO [RS:0;jenkins-hbase6:44517] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 12:27:41,397 INFO [RS:0;jenkins-hbase6:44517] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,44517,1690201659253-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:41,400 INFO [RS:2;jenkins-hbase6:36595] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 12:27:41,402 INFO [RS:1;jenkins-hbase6:44275] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:41,402 INFO [RS:1;jenkins-hbase6:44275] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:41,402 INFO [RS:1;jenkins-hbase6:44275] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:41,402 INFO [RS:2;jenkins-hbase6:36595] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,36595,1690201659396-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:41,437 INFO [RS:1;jenkins-hbase6:44275] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 12:27:41,438 INFO [RS:1;jenkins-hbase6:44275] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,44275,1690201659331-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:41,439 INFO [RS:0;jenkins-hbase6:44517] regionserver.Replication(203): jenkins-hbase6.apache.org,44517,1690201659253 started 2023-07-24 12:27:41,439 INFO [RS:0;jenkins-hbase6:44517] regionserver.HRegionServer(1637): Serving as jenkins-hbase6.apache.org,44517,1690201659253, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:44517, sessionid=0x100bed88b280001 2023-07-24 12:27:41,440 DEBUG [RS:0;jenkins-hbase6:44517] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 12:27:41,440 DEBUG [RS:0;jenkins-hbase6:44517] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:41,440 DEBUG [RS:0;jenkins-hbase6:44517] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,44517,1690201659253' 2023-07-24 12:27:41,440 DEBUG [RS:0;jenkins-hbase6:44517] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 12:27:41,441 DEBUG [RS:0;jenkins-hbase6:44517] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 12:27:41,442 DEBUG [RS:0;jenkins-hbase6:44517] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 12:27:41,442 DEBUG [RS:0;jenkins-hbase6:44517] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 12:27:41,442 DEBUG [RS:0;jenkins-hbase6:44517] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:41,442 DEBUG [RS:0;jenkins-hbase6:44517] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,44517,1690201659253' 2023-07-24 12:27:41,442 DEBUG [RS:0;jenkins-hbase6:44517] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:27:41,443 DEBUG [RS:0;jenkins-hbase6:44517] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:27:41,444 DEBUG [RS:0;jenkins-hbase6:44517] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 12:27:41,444 INFO [RS:0;jenkins-hbase6:44517] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 12:27:41,445 INFO [RS:0;jenkins-hbase6:44517] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 12:27:41,454 INFO [RS:2;jenkins-hbase6:36595] regionserver.Replication(203): jenkins-hbase6.apache.org,36595,1690201659396 started 2023-07-24 12:27:41,454 INFO [RS:2;jenkins-hbase6:36595] regionserver.HRegionServer(1637): Serving as jenkins-hbase6.apache.org,36595,1690201659396, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:36595, sessionid=0x100bed88b280003 2023-07-24 12:27:41,454 DEBUG [RS:2;jenkins-hbase6:36595] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 12:27:41,454 DEBUG [RS:2;jenkins-hbase6:36595] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:41,455 DEBUG [RS:2;jenkins-hbase6:36595] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,36595,1690201659396' 2023-07-24 12:27:41,457 DEBUG [RS:2;jenkins-hbase6:36595] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 12:27:41,457 DEBUG [RS:2;jenkins-hbase6:36595] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 12:27:41,459 DEBUG [RS:2;jenkins-hbase6:36595] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 12:27:41,459 DEBUG [RS:2;jenkins-hbase6:36595] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 12:27:41,459 DEBUG [RS:2;jenkins-hbase6:36595] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:41,460 DEBUG [RS:2;jenkins-hbase6:36595] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,36595,1690201659396' 2023-07-24 12:27:41,460 DEBUG [RS:2;jenkins-hbase6:36595] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:27:41,467 DEBUG [RS:2;jenkins-hbase6:36595] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:27:41,468 INFO [RS:1;jenkins-hbase6:44275] regionserver.Replication(203): jenkins-hbase6.apache.org,44275,1690201659331 started 2023-07-24 12:27:41,468 INFO [RS:1;jenkins-hbase6:44275] regionserver.HRegionServer(1637): Serving as jenkins-hbase6.apache.org,44275,1690201659331, RpcServer on jenkins-hbase6.apache.org/172.31.2.20:44275, sessionid=0x100bed88b280002 2023-07-24 12:27:41,468 DEBUG [RS:1;jenkins-hbase6:44275] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 12:27:41,468 DEBUG [RS:1;jenkins-hbase6:44275] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:41,468 DEBUG [RS:1;jenkins-hbase6:44275] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,44275,1690201659331' 2023-07-24 12:27:41,468 DEBUG [RS:1;jenkins-hbase6:44275] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 12:27:41,468 DEBUG [RS:2;jenkins-hbase6:36595] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 12:27:41,468 INFO [RS:2;jenkins-hbase6:36595] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 12:27:41,469 INFO [RS:2;jenkins-hbase6:36595] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 12:27:41,471 DEBUG [RS:1;jenkins-hbase6:44275] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 12:27:41,475 DEBUG [RS:1;jenkins-hbase6:44275] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 12:27:41,475 DEBUG [RS:1;jenkins-hbase6:44275] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 12:27:41,475 DEBUG [RS:1;jenkins-hbase6:44275] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:41,475 DEBUG [RS:1;jenkins-hbase6:44275] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase6.apache.org,44275,1690201659331' 2023-07-24 12:27:41,475 DEBUG [RS:1;jenkins-hbase6:44275] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:27:41,476 DEBUG [RS:1;jenkins-hbase6:44275] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:27:41,476 DEBUG [RS:1;jenkins-hbase6:44275] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 12:27:41,476 INFO [RS:1;jenkins-hbase6:44275] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 12:27:41,476 INFO [RS:1;jenkins-hbase6:44275] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 12:27:41,536 DEBUG [jenkins-hbase6:38215] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-24 12:27:41,541 DEBUG [jenkins-hbase6:38215] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-07-24 12:27:41,547 DEBUG [jenkins-hbase6:38215] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 12:27:41,548 DEBUG [jenkins-hbase6:38215] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 12:27:41,548 DEBUG [jenkins-hbase6:38215] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 12:27:41,548 DEBUG [jenkins-hbase6:38215] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 12:27:41,551 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,44517,1690201659253, state=OPENING 2023-07-24 12:27:41,557 INFO [RS:0;jenkins-hbase6:44517] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C44517%2C1690201659253, suffix=, logDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/WALs/jenkins-hbase6.apache.org,44517,1690201659253, archiveDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/oldWALs, maxLogs=32 2023-07-24 12:27:41,560 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-24 12:27:41,566 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 12:27:41,567 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-24 12:27:41,571 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,44517,1690201659253}] 2023-07-24 12:27:41,574 INFO [RS:2;jenkins-hbase6:36595] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C36595%2C1690201659396, suffix=, logDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/WALs/jenkins-hbase6.apache.org,36595,1690201659396, archiveDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/oldWALs, maxLogs=32 2023-07-24 12:27:41,586 INFO [RS:1;jenkins-hbase6:44275] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C44275%2C1690201659331, suffix=, logDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/WALs/jenkins-hbase6.apache.org,44275,1690201659331, archiveDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/oldWALs, maxLogs=32 2023-07-24 12:27:41,593 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43797,DS-21f48b93-604b-4af4-9812-20eaca723149,DISK] 2023-07-24 12:27:41,596 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45287,DS-6f247f65-0d00-472a-bb0b-558b14302ed8,DISK] 2023-07-24 12:27:41,596 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37201,DS-351b676a-cf55-41c3-9aff-33876010284b,DISK] 2023-07-24 12:27:41,637 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45287,DS-6f247f65-0d00-472a-bb0b-558b14302ed8,DISK] 2023-07-24 12:27:41,638 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43797,DS-21f48b93-604b-4af4-9812-20eaca723149,DISK] 2023-07-24 12:27:41,638 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37201,DS-351b676a-cf55-41c3-9aff-33876010284b,DISK] 2023-07-24 12:27:41,640 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37201,DS-351b676a-cf55-41c3-9aff-33876010284b,DISK] 2023-07-24 12:27:41,640 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43797,DS-21f48b93-604b-4af4-9812-20eaca723149,DISK] 2023-07-24 12:27:41,641 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45287,DS-6f247f65-0d00-472a-bb0b-558b14302ed8,DISK] 2023-07-24 12:27:41,643 INFO [RS:0;jenkins-hbase6:44517] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/WALs/jenkins-hbase6.apache.org,44517,1690201659253/jenkins-hbase6.apache.org%2C44517%2C1690201659253.1690201661560 2023-07-24 12:27:41,655 DEBUG [RS:0;jenkins-hbase6:44517] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43797,DS-21f48b93-604b-4af4-9812-20eaca723149,DISK], DatanodeInfoWithStorage[127.0.0.1:37201,DS-351b676a-cf55-41c3-9aff-33876010284b,DISK], DatanodeInfoWithStorage[127.0.0.1:45287,DS-6f247f65-0d00-472a-bb0b-558b14302ed8,DISK]] 2023-07-24 12:27:41,674 INFO [RS:2;jenkins-hbase6:36595] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/WALs/jenkins-hbase6.apache.org,36595,1690201659396/jenkins-hbase6.apache.org%2C36595%2C1690201659396.1690201661584 2023-07-24 12:27:41,674 DEBUG [RS:2;jenkins-hbase6:36595] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43797,DS-21f48b93-604b-4af4-9812-20eaca723149,DISK], DatanodeInfoWithStorage[127.0.0.1:37201,DS-351b676a-cf55-41c3-9aff-33876010284b,DISK], DatanodeInfoWithStorage[127.0.0.1:45287,DS-6f247f65-0d00-472a-bb0b-558b14302ed8,DISK]] 2023-07-24 12:27:41,676 INFO [RS:1;jenkins-hbase6:44275] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/WALs/jenkins-hbase6.apache.org,44275,1690201659331/jenkins-hbase6.apache.org%2C44275%2C1690201659331.1690201661588 2023-07-24 12:27:41,676 DEBUG [RS:1;jenkins-hbase6:44275] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37201,DS-351b676a-cf55-41c3-9aff-33876010284b,DISK], DatanodeInfoWithStorage[127.0.0.1:45287,DS-6f247f65-0d00-472a-bb0b-558b14302ed8,DISK], DatanodeInfoWithStorage[127.0.0.1:43797,DS-21f48b93-604b-4af4-9812-20eaca723149,DISK]] 2023-07-24 12:27:41,797 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:41,800 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 12:27:41,804 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:37596, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 12:27:41,819 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-24 12:27:41,819 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 12:27:41,823 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase6.apache.org%2C44517%2C1690201659253.meta, suffix=.meta, logDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/WALs/jenkins-hbase6.apache.org,44517,1690201659253, archiveDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/oldWALs, maxLogs=32 2023-07-24 12:27:41,851 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45287,DS-6f247f65-0d00-472a-bb0b-558b14302ed8,DISK] 2023-07-24 12:27:41,851 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37201,DS-351b676a-cf55-41c3-9aff-33876010284b,DISK] 2023-07-24 12:27:41,856 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43797,DS-21f48b93-604b-4af4-9812-20eaca723149,DISK] 2023-07-24 12:27:41,862 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/WALs/jenkins-hbase6.apache.org,44517,1690201659253/jenkins-hbase6.apache.org%2C44517%2C1690201659253.meta.1690201661825.meta 2023-07-24 12:27:41,867 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45287,DS-6f247f65-0d00-472a-bb0b-558b14302ed8,DISK], DatanodeInfoWithStorage[127.0.0.1:37201,DS-351b676a-cf55-41c3-9aff-33876010284b,DISK], DatanodeInfoWithStorage[127.0.0.1:43797,DS-21f48b93-604b-4af4-9812-20eaca723149,DISK]] 2023-07-24 12:27:41,868 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-24 12:27:41,869 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-24 12:27:41,871 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 12:27:41,871 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-24 12:27:41,875 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-24 12:27:41,876 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-24 12:27:41,889 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-24 12:27:41,889 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:27:41,889 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-24 12:27:41,889 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-24 12:27:41,893 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-24 12:27:41,900 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740/info 2023-07-24 12:27:41,900 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740/info 2023-07-24 12:27:41,901 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-24 12:27:41,902 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 12:27:41,902 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-24 12:27:41,904 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740/rep_barrier 2023-07-24 12:27:41,904 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740/rep_barrier 2023-07-24 12:27:41,905 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-24 12:27:41,906 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 12:27:41,906 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-24 12:27:41,907 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740/table 2023-07-24 12:27:41,907 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740/table 2023-07-24 12:27:41,908 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-24 12:27:41,909 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 12:27:41,910 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740 2023-07-24 12:27:41,915 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740 2023-07-24 12:27:41,919 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-24 12:27:41,928 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-24 12:27:41,929 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65331183, jitterRate=-0.026489511132240295}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-24 12:27:41,932 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-24 12:27:41,942 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690201661784 2023-07-24 12:27:41,961 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-24 12:27:41,962 INFO [RS_OPEN_META-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-24 12:27:41,963 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase6.apache.org,44517,1690201659253, state=OPEN 2023-07-24 12:27:41,966 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-24 12:27:41,966 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-24 12:27:41,971 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-24 12:27:41,971 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase6.apache.org,44517,1690201659253 in 395 msec 2023-07-24 12:27:41,978 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-24 12:27:41,979 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 636 msec 2023-07-24 12:27:41,991 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1660 sec 2023-07-24 12:27:41,991 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690201661991, completionTime=-1 2023-07-24 12:27:41,991 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-24 12:27:41,991 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-24 12:27:42,071 DEBUG [hconnection-0x4f8b35dd-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:27:42,077 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:37606, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:27:42,101 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-24 12:27:42,101 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690201722101 2023-07-24 12:27:42,101 INFO [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690201782101 2023-07-24 12:27:42,101 INFO [master/jenkins-hbase6:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 109 msec 2023-07-24 12:27:42,135 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,38215,1690201657817-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:42,135 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,38215,1690201657817-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:42,135 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,38215,1690201657817-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:42,138 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase6:38215, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:42,139 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-24 12:27:42,149 DEBUG [master/jenkins-hbase6:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-24 12:27:42,156 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-24 12:27:42,157 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 12:27:42,169 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-24 12:27:42,172 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 12:27:42,175 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 12:27:42,202 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/hbase/namespace/0157ff2227367fdf1e099de19af17c90 2023-07-24 12:27:42,205 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/hbase/namespace/0157ff2227367fdf1e099de19af17c90 empty. 2023-07-24 12:27:42,206 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/hbase/namespace/0157ff2227367fdf1e099de19af17c90 2023-07-24 12:27:42,206 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-24 12:27:42,266 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-24 12:27:42,270 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0157ff2227367fdf1e099de19af17c90, NAME => 'hbase:namespace,,1690201662157.0157ff2227367fdf1e099de19af17c90.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp 2023-07-24 12:27:42,293 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690201662157.0157ff2227367fdf1e099de19af17c90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:27:42,293 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 0157ff2227367fdf1e099de19af17c90, disabling compactions & flushes 2023-07-24 12:27:42,294 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690201662157.0157ff2227367fdf1e099de19af17c90. 2023-07-24 12:27:42,294 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690201662157.0157ff2227367fdf1e099de19af17c90. 2023-07-24 12:27:42,294 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690201662157.0157ff2227367fdf1e099de19af17c90. after waiting 0 ms 2023-07-24 12:27:42,294 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690201662157.0157ff2227367fdf1e099de19af17c90. 2023-07-24 12:27:42,294 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690201662157.0157ff2227367fdf1e099de19af17c90. 2023-07-24 12:27:42,294 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 0157ff2227367fdf1e099de19af17c90: 2023-07-24 12:27:42,299 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 12:27:42,318 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690201662157.0157ff2227367fdf1e099de19af17c90.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690201662303"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201662303"}]},"ts":"1690201662303"} 2023-07-24 12:27:42,345 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-24 12:27:42,347 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 12:27:42,353 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201662348"}]},"ts":"1690201662348"} 2023-07-24 12:27:42,356 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-24 12:27:42,360 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-07-24 12:27:42,361 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 12:27:42,361 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 12:27:42,361 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 12:27:42,361 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 12:27:42,363 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0157ff2227367fdf1e099de19af17c90, ASSIGN}] 2023-07-24 12:27:42,366 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0157ff2227367fdf1e099de19af17c90, ASSIGN 2023-07-24 12:27:42,368 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=0157ff2227367fdf1e099de19af17c90, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,36595,1690201659396; forceNewPlan=false, retain=false 2023-07-24 12:27:42,524 INFO [jenkins-hbase6:38215] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 12:27:42,525 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0157ff2227367fdf1e099de19af17c90, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:42,526 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690201662157.0157ff2227367fdf1e099de19af17c90.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690201662525"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201662525"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201662525"}]},"ts":"1690201662525"} 2023-07-24 12:27:42,529 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 0157ff2227367fdf1e099de19af17c90, server=jenkins-hbase6.apache.org,36595,1690201659396}] 2023-07-24 12:27:42,683 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:42,684 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 12:27:42,687 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:47376, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 12:27:42,695 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690201662157.0157ff2227367fdf1e099de19af17c90. 2023-07-24 12:27:42,695 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0157ff2227367fdf1e099de19af17c90, NAME => 'hbase:namespace,,1690201662157.0157ff2227367fdf1e099de19af17c90.', STARTKEY => '', ENDKEY => ''} 2023-07-24 12:27:42,696 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690201662157.0157ff2227367fdf1e099de19af17c90. service=AccessControlService 2023-07-24 12:27:42,696 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 12:27:42,697 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 0157ff2227367fdf1e099de19af17c90 2023-07-24 12:27:42,697 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690201662157.0157ff2227367fdf1e099de19af17c90.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:27:42,697 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 0157ff2227367fdf1e099de19af17c90 2023-07-24 12:27:42,697 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 0157ff2227367fdf1e099de19af17c90 2023-07-24 12:27:42,703 INFO [StoreOpener-0157ff2227367fdf1e099de19af17c90-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 0157ff2227367fdf1e099de19af17c90 2023-07-24 12:27:42,706 DEBUG [StoreOpener-0157ff2227367fdf1e099de19af17c90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/namespace/0157ff2227367fdf1e099de19af17c90/info 2023-07-24 12:27:42,706 DEBUG [StoreOpener-0157ff2227367fdf1e099de19af17c90-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/namespace/0157ff2227367fdf1e099de19af17c90/info 2023-07-24 12:27:42,707 INFO [StoreOpener-0157ff2227367fdf1e099de19af17c90-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0157ff2227367fdf1e099de19af17c90 columnFamilyName info 2023-07-24 12:27:42,708 INFO [StoreOpener-0157ff2227367fdf1e099de19af17c90-1] regionserver.HStore(310): Store=0157ff2227367fdf1e099de19af17c90/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 12:27:42,710 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/namespace/0157ff2227367fdf1e099de19af17c90 2023-07-24 12:27:42,711 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/namespace/0157ff2227367fdf1e099de19af17c90 2023-07-24 12:27:42,716 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 0157ff2227367fdf1e099de19af17c90 2023-07-24 12:27:42,725 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/namespace/0157ff2227367fdf1e099de19af17c90/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 12:27:42,727 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 0157ff2227367fdf1e099de19af17c90; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71981681, jitterRate=0.07261063158512115}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 12:27:42,727 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 0157ff2227367fdf1e099de19af17c90: 2023-07-24 12:27:42,733 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690201662157.0157ff2227367fdf1e099de19af17c90., pid=6, masterSystemTime=1690201662683 2023-07-24 12:27:42,739 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690201662157.0157ff2227367fdf1e099de19af17c90. 2023-07-24 12:27:42,740 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690201662157.0157ff2227367fdf1e099de19af17c90. 2023-07-24 12:27:42,741 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0157ff2227367fdf1e099de19af17c90, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:42,741 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690201662157.0157ff2227367fdf1e099de19af17c90.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690201662740"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690201662740"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690201662740"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690201662740"}]},"ts":"1690201662740"} 2023-07-24 12:27:42,752 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-24 12:27:42,752 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 0157ff2227367fdf1e099de19af17c90, server=jenkins-hbase6.apache.org,36595,1690201659396 in 218 msec 2023-07-24 12:27:42,756 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-24 12:27:42,758 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=0157ff2227367fdf1e099de19af17c90, ASSIGN in 389 msec 2023-07-24 12:27:42,760 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 12:27:42,760 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201662760"}]},"ts":"1690201662760"} 2023-07-24 12:27:42,762 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-24 12:27:42,766 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 12:27:42,770 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 608 msec 2023-07-24 12:27:42,772 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-24 12:27:42,774 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-24 12:27:42,774 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 12:27:42,801 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:27:42,803 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:47380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:27:42,822 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-24 12:27:42,845 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-24 12:27:42,853 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 41 msec 2023-07-24 12:27:42,858 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-24 12:27:42,872 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-24 12:27:42,877 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-07-24 12:27:42,885 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-24 12:27:42,888 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-24 12:27:42,888 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.406sec 2023-07-24 12:27:42,892 INFO [master/jenkins-hbase6:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-24 12:27:42,895 INFO [master/jenkins-hbase6:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-24 12:27:42,895 INFO [master/jenkins-hbase6:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-24 12:27:42,896 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,38215,1690201657817-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-24 12:27:42,897 INFO [master/jenkins-hbase6:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase6.apache.org,38215,1690201657817-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-24 12:27:42,921 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 12:27:42,923 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-24 12:27:42,926 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 12:27:42,927 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 12:27:42,931 INFO [master/jenkins-hbase6:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-24 12:27:42,933 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/hbase/acl/17bddcd2885a71d9ecf0f33defdd86ee 2023-07-24 12:27:42,933 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/hbase/acl/17bddcd2885a71d9ecf0f33defdd86ee empty. 2023-07-24 12:27:42,936 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/hbase/acl/17bddcd2885a71d9ecf0f33defdd86ee 2023-07-24 12:27:42,936 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-24 12:27:42,941 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 12:27:42,950 DEBUG [Listener at localhost/36245] zookeeper.ReadOnlyZKClient(139): Connect 0x71d6bc92 to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:27:42,961 DEBUG [Listener at localhost/36245] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@735b0e85, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:27:42,974 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-24 12:27:42,976 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 17bddcd2885a71d9ecf0f33defdd86ee, NAME => 'hbase:acl,,1690201662916.17bddcd2885a71d9ecf0f33defdd86ee.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp 2023-07-24 12:27:42,982 DEBUG [hconnection-0x3d003e3c-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:27:43,009 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:37608, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:27:43,014 INFO [Listener at localhost/36245] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase6.apache.org,38215,1690201657817 2023-07-24 12:27:43,014 INFO [Listener at localhost/36245] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-24 12:27:43,015 INFO [Listener at localhost/36245] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/test.cache.data in system properties and HBase conf 2023-07-24 12:27:43,015 INFO [Listener at localhost/36245] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/hadoop.tmp.dir in system properties and HBase conf 2023-07-24 12:27:43,015 INFO [Listener at localhost/36245] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/hadoop.log.dir in system properties and HBase conf 2023-07-24 12:27:43,015 INFO [Listener at localhost/36245] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-24 12:27:43,015 INFO [Listener at localhost/36245] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-24 12:27:43,015 INFO [Listener at localhost/36245] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-24 12:27:43,015 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690201662916.17bddcd2885a71d9ecf0f33defdd86ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:27:43,015 INFO [Listener at localhost/36245] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-24 12:27:43,015 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 17bddcd2885a71d9ecf0f33defdd86ee, disabling compactions & flushes 2023-07-24 12:27:43,015 INFO [Listener at localhost/36245] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-24 12:27:43,015 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690201662916.17bddcd2885a71d9ecf0f33defdd86ee. 2023-07-24 12:27:43,016 INFO [Listener at localhost/36245] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-24 12:27:43,016 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690201662916.17bddcd2885a71d9ecf0f33defdd86ee. 2023-07-24 12:27:43,016 INFO [Listener at localhost/36245] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 12:27:43,016 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690201662916.17bddcd2885a71d9ecf0f33defdd86ee. after waiting 0 ms 2023-07-24 12:27:43,016 INFO [Listener at localhost/36245] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-24 12:27:43,016 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690201662916.17bddcd2885a71d9ecf0f33defdd86ee. 2023-07-24 12:27:43,016 INFO [Listener at localhost/36245] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-24 12:27:43,016 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1690201662916.17bddcd2885a71d9ecf0f33defdd86ee. 2023-07-24 12:27:43,016 INFO [Listener at localhost/36245] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 12:27:43,016 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 17bddcd2885a71d9ecf0f33defdd86ee: 2023-07-24 12:27:43,016 INFO [Listener at localhost/36245] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 12:27:43,017 INFO [Listener at localhost/36245] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-24 12:27:43,017 INFO [Listener at localhost/36245] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/nfs.dump.dir in system properties and HBase conf 2023-07-24 12:27:43,017 INFO [Listener at localhost/36245] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/java.io.tmpdir in system properties and HBase conf 2023-07-24 12:27:43,017 INFO [Listener at localhost/36245] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 12:27:43,017 INFO [Listener at localhost/36245] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-24 12:27:43,017 INFO [Listener at localhost/36245] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-24 12:27:43,021 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 12:27:43,022 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1690201662916.17bddcd2885a71d9ecf0f33defdd86ee.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690201663022"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201663022"}]},"ts":"1690201663022"} 2023-07-24 12:27:43,025 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-24 12:27:43,027 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 12:27:43,027 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201663027"}]},"ts":"1690201663027"} 2023-07-24 12:27:43,029 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-24 12:27:43,036 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-07-24 12:27:43,037 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 12:27:43,037 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 12:27:43,037 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 12:27:43,037 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 12:27:43,037 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=17bddcd2885a71d9ecf0f33defdd86ee, ASSIGN}] 2023-07-24 12:27:43,040 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=17bddcd2885a71d9ecf0f33defdd86ee, ASSIGN 2023-07-24 12:27:43,042 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=17bddcd2885a71d9ecf0f33defdd86ee, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,36595,1690201659396; forceNewPlan=false, retain=false 2023-07-24 12:27:43,045 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 12:27:43,192 INFO [jenkins-hbase6:38215] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 12:27:43,193 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=17bddcd2885a71d9ecf0f33defdd86ee, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:43,193 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1690201662916.17bddcd2885a71d9ecf0f33defdd86ee.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690201663193"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201663193"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201663193"}]},"ts":"1690201663193"} 2023-07-24 12:27:43,197 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 17bddcd2885a71d9ecf0f33defdd86ee, server=jenkins-hbase6.apache.org,36595,1690201659396}] 2023-07-24 12:27:43,245 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 12:27:43,367 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1690201662916.17bddcd2885a71d9ecf0f33defdd86ee. 2023-07-24 12:27:43,367 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 17bddcd2885a71d9ecf0f33defdd86ee, NAME => 'hbase:acl,,1690201662916.17bddcd2885a71d9ecf0f33defdd86ee.', STARTKEY => '', ENDKEY => ''} 2023-07-24 12:27:43,368 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690201662916.17bddcd2885a71d9ecf0f33defdd86ee. service=AccessControlService 2023-07-24 12:27:43,368 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 12:27:43,368 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 17bddcd2885a71d9ecf0f33defdd86ee 2023-07-24 12:27:43,368 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690201662916.17bddcd2885a71d9ecf0f33defdd86ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:27:43,368 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 17bddcd2885a71d9ecf0f33defdd86ee 2023-07-24 12:27:43,369 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 17bddcd2885a71d9ecf0f33defdd86ee 2023-07-24 12:27:43,379 INFO [StoreOpener-17bddcd2885a71d9ecf0f33defdd86ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 17bddcd2885a71d9ecf0f33defdd86ee 2023-07-24 12:27:43,389 DEBUG [StoreOpener-17bddcd2885a71d9ecf0f33defdd86ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/acl/17bddcd2885a71d9ecf0f33defdd86ee/l 2023-07-24 12:27:43,389 DEBUG [StoreOpener-17bddcd2885a71d9ecf0f33defdd86ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/acl/17bddcd2885a71d9ecf0f33defdd86ee/l 2023-07-24 12:27:43,390 INFO [StoreOpener-17bddcd2885a71d9ecf0f33defdd86ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 17bddcd2885a71d9ecf0f33defdd86ee columnFamilyName l 2023-07-24 12:27:43,394 INFO [StoreOpener-17bddcd2885a71d9ecf0f33defdd86ee-1] regionserver.HStore(310): Store=17bddcd2885a71d9ecf0f33defdd86ee/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 12:27:43,397 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/acl/17bddcd2885a71d9ecf0f33defdd86ee 2023-07-24 12:27:43,399 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/acl/17bddcd2885a71d9ecf0f33defdd86ee 2023-07-24 12:27:43,405 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 17bddcd2885a71d9ecf0f33defdd86ee 2023-07-24 12:27:43,421 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/acl/17bddcd2885a71d9ecf0f33defdd86ee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 12:27:43,422 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 17bddcd2885a71d9ecf0f33defdd86ee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68623065, jitterRate=0.022563353180885315}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 12:27:43,422 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 17bddcd2885a71d9ecf0f33defdd86ee: 2023-07-24 12:27:43,428 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1690201662916.17bddcd2885a71d9ecf0f33defdd86ee., pid=11, masterSystemTime=1690201663358 2023-07-24 12:27:43,432 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1690201662916.17bddcd2885a71d9ecf0f33defdd86ee. 2023-07-24 12:27:43,432 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1690201662916.17bddcd2885a71d9ecf0f33defdd86ee. 2023-07-24 12:27:43,432 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=17bddcd2885a71d9ecf0f33defdd86ee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:43,433 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1690201662916.17bddcd2885a71d9ecf0f33defdd86ee.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690201663432"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690201663432"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690201663432"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690201663432"}]},"ts":"1690201663432"} 2023-07-24 12:27:43,443 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-24 12:27:43,443 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 17bddcd2885a71d9ecf0f33defdd86ee, server=jenkins-hbase6.apache.org,36595,1690201659396 in 239 msec 2023-07-24 12:27:43,448 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-24 12:27:43,448 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=17bddcd2885a71d9ecf0f33defdd86ee, ASSIGN in 406 msec 2023-07-24 12:27:43,449 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 12:27:43,450 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201663449"}]},"ts":"1690201663449"} 2023-07-24 12:27:43,452 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-24 12:27:43,456 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 12:27:43,460 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 534 msec 2023-07-24 12:27:43,546 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 12:27:43,546 INFO [master/jenkins-hbase6:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-24 12:27:43,558 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-24 12:27:44,349 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 12:27:44,624 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 12:27:44,629 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/java.io.tmpdir/Jetty_jenkins.hbase6_apache_org_41733_jobhistory____yi8nmp/webapp 2023-07-24 12:27:44,790 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-24 12:27:44,790 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-24 12:27:44,790 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 12:27:44,793 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 12:27:44,863 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 12:27:45,168 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 12:27:45,559 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-24 12:27:45,603 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase6.apache.org:41733 2023-07-24 12:27:45,845 WARN [Listener at jenkins-hbase6.apache.org/45495] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 12:27:46,224 WARN [Listener at jenkins-hbase6.apache.org/45495] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 12:27:46,228 INFO [Listener at jenkins-hbase6.apache.org/45495] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 12:27:46,240 INFO [Listener at jenkins-hbase6.apache.org/45495] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/java.io.tmpdir/Jetty_jenkins.hbase6_apache_org_33327_cluster____.hv74qa/webapp 2023-07-24 12:27:46,326 INFO [Listener at jenkins-hbase6.apache.org/45495] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 12:27:46,326 INFO [Listener at jenkins-hbase6.apache.org/45495] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-24 12:27:46,326 INFO [Listener at jenkins-hbase6.apache.org/45495] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 12:27:46,327 INFO [Listener at jenkins-hbase6.apache.org/45495] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 12:27:46,336 INFO [Listener at jenkins-hbase6.apache.org/45495] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 12:27:46,646 INFO [Listener at jenkins-hbase6.apache.org/45495] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 12:27:46,834 INFO [Listener at jenkins-hbase6.apache.org/45495] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 12:27:46,848 INFO [Listener at jenkins-hbase6.apache.org/45495] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase6.apache.org:33327 2023-07-24 12:27:47,331 WARN [Listener at jenkins-hbase6.apache.org/40259] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 12:27:47,358 WARN [Listener at jenkins-hbase6.apache.org/40259] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 12:27:47,359 INFO [Listener at jenkins-hbase6.apache.org/40259] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 12:27:47,370 INFO [Listener at jenkins-hbase6.apache.org/40259] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/java.io.tmpdir/Jetty_jenkins.hbase6_apache_org_36303_node____srivu7/webapp 2023-07-24 12:27:47,422 INFO [Listener at jenkins-hbase6.apache.org/40259] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-24 12:27:47,423 INFO [Listener at jenkins-hbase6.apache.org/40259] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 12:27:47,423 INFO [Listener at jenkins-hbase6.apache.org/40259] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 12:27:47,423 INFO [Listener at jenkins-hbase6.apache.org/40259] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 12:27:47,432 INFO [Listener at jenkins-hbase6.apache.org/40259] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 12:27:47,452 INFO [Listener at jenkins-hbase6.apache.org/40259] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 12:27:47,476 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 12:27:47,604 INFO [Listener at jenkins-hbase6.apache.org/40259] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 12:27:47,627 INFO [Listener at jenkins-hbase6.apache.org/40259] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase6.apache.org:36303 2023-07-24 12:27:47,759 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-24 12:27:47,761 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-24 12:27:47,762 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-24 12:27:47,937 WARN [Listener at jenkins-hbase6.apache.org/41373] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 12:27:47,946 WARN [Listener at jenkins-hbase6.apache.org/41373] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 12:27:47,947 INFO [Listener at jenkins-hbase6.apache.org/41373] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 12:27:47,955 INFO [Listener at jenkins-hbase6.apache.org/41373] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/java.io.tmpdir/Jetty_jenkins.hbase6_apache_org_46167_node____fb87sc/webapp 2023-07-24 12:27:47,999 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 12:27:47,999 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-24 12:27:48,000 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 12:27:48,000 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-24 12:27:48,000 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 12:27:48,000 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-24 12:27:48,001 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 12:27:48,001 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-24 12:27:48,001 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 12:27:48,001 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-24 12:27:48,019 INFO [Listener at jenkins-hbase6.apache.org/41373] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-24 12:27:48,019 INFO [Listener at jenkins-hbase6.apache.org/41373] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 12:27:48,019 INFO [Listener at jenkins-hbase6.apache.org/41373] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 12:27:48,019 INFO [Listener at jenkins-hbase6.apache.org/41373] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 12:27:48,029 INFO [Listener at jenkins-hbase6.apache.org/41373] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 12:27:48,050 INFO [Listener at jenkins-hbase6.apache.org/41373] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 12:27:48,144 INFO [Listener at jenkins-hbase6.apache.org/41373] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 12:27:48,151 INFO [Listener at jenkins-hbase6.apache.org/41373] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase6.apache.org:46167 2023-07-24 12:27:48,181 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-24 12:27:48,183 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 12:27:48,249 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=704, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=266, ProcessCount=171, AvailableMemoryMB=454 2023-07-24 12:27:48,249 WARN [Listener at jenkins-hbase6.apache.org/41373] hbase.ResourceChecker(130): Thread=704 is superior to 500 2023-07-24 12:27:48,265 DEBUG [Listener at jenkins-hbase6.apache.org/41373] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-24 12:27:48,270 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:58080, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-24 12:27:48,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.HMaster$4(2112): Client=jenkins//172.31.2.20 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 12:27:48,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-24 12:27:48,286 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 12:27:48,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(700): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-24 12:27:48,289 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 12:27:48,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 12:27:48,295 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportWithTargetName/7ceaa4326cc6ecaed2b9a5b915e1eb74 2023-07-24 12:27:48,300 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportWithTargetName/1bf83f930752d2d55b8cbd0f9855cec2 2023-07-24 12:27:48,301 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportWithTargetName/7ceaa4326cc6ecaed2b9a5b915e1eb74 empty. 2023-07-24 12:27:48,301 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportWithTargetName/1bf83f930752d2d55b8cbd0f9855cec2 empty. 2023-07-24 12:27:48,303 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportWithTargetName/7ceaa4326cc6ecaed2b9a5b915e1eb74 2023-07-24 12:27:48,303 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportWithTargetName/1bf83f930752d2d55b8cbd0f9855cec2 2023-07-24 12:27:48,303 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-24 12:27:48,342 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-24 12:27:48,344 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7ceaa4326cc6ecaed2b9a5b915e1eb74, NAME => 'testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp 2023-07-24 12:27:48,347 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 1bf83f930752d2d55b8cbd0f9855cec2, NAME => 'testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp 2023-07-24 12:27:48,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 12:27:48,398 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:27:48,399 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 7ceaa4326cc6ecaed2b9a5b915e1eb74, disabling compactions & flushes 2023-07-24 12:27:48,399 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74. 2023-07-24 12:27:48,399 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74. 2023-07-24 12:27:48,399 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74. after waiting 0 ms 2023-07-24 12:27:48,399 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74. 2023-07-24 12:27:48,399 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74. 2023-07-24 12:27:48,399 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 7ceaa4326cc6ecaed2b9a5b915e1eb74: 2023-07-24 12:27:48,401 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:27:48,401 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 1bf83f930752d2d55b8cbd0f9855cec2, disabling compactions & flushes 2023-07-24 12:27:48,401 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2. 2023-07-24 12:27:48,401 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2. 2023-07-24 12:27:48,401 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2. after waiting 0 ms 2023-07-24 12:27:48,401 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2. 2023-07-24 12:27:48,401 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2. 2023-07-24 12:27:48,401 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 1bf83f930752d2d55b8cbd0f9855cec2: 2023-07-24 12:27:48,406 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 12:27:48,407 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690201668407"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201668407"}]},"ts":"1690201668407"} 2023-07-24 12:27:48,408 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690201668407"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201668407"}]},"ts":"1690201668407"} 2023-07-24 12:27:48,464 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 12:27:48,466 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 12:27:48,466 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201668466"}]},"ts":"1690201668466"} 2023-07-24 12:27:48,468 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-24 12:27:48,473 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-07-24 12:27:48,475 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 12:27:48,476 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 12:27:48,476 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 12:27:48,476 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 12:27:48,476 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7ceaa4326cc6ecaed2b9a5b915e1eb74, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1bf83f930752d2d55b8cbd0f9855cec2, ASSIGN}] 2023-07-24 12:27:48,479 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1bf83f930752d2d55b8cbd0f9855cec2, ASSIGN 2023-07-24 12:27:48,479 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7ceaa4326cc6ecaed2b9a5b915e1eb74, ASSIGN 2023-07-24 12:27:48,481 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7ceaa4326cc6ecaed2b9a5b915e1eb74, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,44275,1690201659331; forceNewPlan=false, retain=false 2023-07-24 12:27:48,481 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1bf83f930752d2d55b8cbd0f9855cec2, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,44517,1690201659253; forceNewPlan=false, retain=false 2023-07-24 12:27:48,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 12:27:48,631 INFO [jenkins-hbase6:38215] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 12:27:48,634 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=1bf83f930752d2d55b8cbd0f9855cec2, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:48,634 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=7ceaa4326cc6ecaed2b9a5b915e1eb74, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:48,634 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690201668634"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201668634"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201668634"}]},"ts":"1690201668634"} 2023-07-24 12:27:48,634 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690201668634"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201668634"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201668634"}]},"ts":"1690201668634"} 2023-07-24 12:27:48,637 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 1bf83f930752d2d55b8cbd0f9855cec2, server=jenkins-hbase6.apache.org,44517,1690201659253}] 2023-07-24 12:27:48,639 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 7ceaa4326cc6ecaed2b9a5b915e1eb74, server=jenkins-hbase6.apache.org,44275,1690201659331}] 2023-07-24 12:27:48,794 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:48,794 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 12:27:48,798 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:41390, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 12:27:48,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2. 2023-07-24 12:27:48,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1bf83f930752d2d55b8cbd0f9855cec2, NAME => 'testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 12:27:48,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2. service=AccessControlService 2023-07-24 12:27:48,800 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 12:27:48,800 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 1bf83f930752d2d55b8cbd0f9855cec2 2023-07-24 12:27:48,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:27:48,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 1bf83f930752d2d55b8cbd0f9855cec2 2023-07-24 12:27:48,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 1bf83f930752d2d55b8cbd0f9855cec2 2023-07-24 12:27:48,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74. 2023-07-24 12:27:48,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7ceaa4326cc6ecaed2b9a5b915e1eb74, NAME => 'testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 12:27:48,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74. service=AccessControlService 2023-07-24 12:27:48,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 12:27:48,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 7ceaa4326cc6ecaed2b9a5b915e1eb74 2023-07-24 12:27:48,804 INFO [StoreOpener-1bf83f930752d2d55b8cbd0f9855cec2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1bf83f930752d2d55b8cbd0f9855cec2 2023-07-24 12:27:48,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:27:48,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 7ceaa4326cc6ecaed2b9a5b915e1eb74 2023-07-24 12:27:48,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 7ceaa4326cc6ecaed2b9a5b915e1eb74 2023-07-24 12:27:48,812 INFO [StoreOpener-7ceaa4326cc6ecaed2b9a5b915e1eb74-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7ceaa4326cc6ecaed2b9a5b915e1eb74 2023-07-24 12:27:48,817 DEBUG [StoreOpener-7ceaa4326cc6ecaed2b9a5b915e1eb74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportWithTargetName/7ceaa4326cc6ecaed2b9a5b915e1eb74/cf 2023-07-24 12:27:48,817 DEBUG [StoreOpener-7ceaa4326cc6ecaed2b9a5b915e1eb74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportWithTargetName/7ceaa4326cc6ecaed2b9a5b915e1eb74/cf 2023-07-24 12:27:48,821 INFO [StoreOpener-7ceaa4326cc6ecaed2b9a5b915e1eb74-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7ceaa4326cc6ecaed2b9a5b915e1eb74 columnFamilyName cf 2023-07-24 12:27:48,824 INFO [StoreOpener-7ceaa4326cc6ecaed2b9a5b915e1eb74-1] regionserver.HStore(310): Store=7ceaa4326cc6ecaed2b9a5b915e1eb74/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 12:27:48,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportWithTargetName/7ceaa4326cc6ecaed2b9a5b915e1eb74 2023-07-24 12:27:48,826 DEBUG [StoreOpener-1bf83f930752d2d55b8cbd0f9855cec2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportWithTargetName/1bf83f930752d2d55b8cbd0f9855cec2/cf 2023-07-24 12:27:48,828 DEBUG [StoreOpener-1bf83f930752d2d55b8cbd0f9855cec2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportWithTargetName/1bf83f930752d2d55b8cbd0f9855cec2/cf 2023-07-24 12:27:48,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportWithTargetName/7ceaa4326cc6ecaed2b9a5b915e1eb74 2023-07-24 12:27:48,829 INFO [StoreOpener-1bf83f930752d2d55b8cbd0f9855cec2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1bf83f930752d2d55b8cbd0f9855cec2 columnFamilyName cf 2023-07-24 12:27:48,831 INFO [StoreOpener-1bf83f930752d2d55b8cbd0f9855cec2-1] regionserver.HStore(310): Store=1bf83f930752d2d55b8cbd0f9855cec2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 12:27:48,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportWithTargetName/1bf83f930752d2d55b8cbd0f9855cec2 2023-07-24 12:27:48,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportWithTargetName/1bf83f930752d2d55b8cbd0f9855cec2 2023-07-24 12:27:48,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 7ceaa4326cc6ecaed2b9a5b915e1eb74 2023-07-24 12:27:48,847 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 1bf83f930752d2d55b8cbd0f9855cec2 2023-07-24 12:27:48,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportWithTargetName/7ceaa4326cc6ecaed2b9a5b915e1eb74/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 12:27:48,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportWithTargetName/1bf83f930752d2d55b8cbd0f9855cec2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 12:27:48,857 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 1bf83f930752d2d55b8cbd0f9855cec2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58975870, jitterRate=-0.12119105458259583}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 12:27:48,857 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 1bf83f930752d2d55b8cbd0f9855cec2: 2023-07-24 12:27:48,858 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 7ceaa4326cc6ecaed2b9a5b915e1eb74; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63446044, jitterRate=-0.05458027124404907}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 12:27:48,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 7ceaa4326cc6ecaed2b9a5b915e1eb74: 2023-07-24 12:27:48,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2., pid=15, masterSystemTime=1690201668790 2023-07-24 12:27:48,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74., pid=16, masterSystemTime=1690201668794 2023-07-24 12:27:48,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74. 2023-07-24 12:27:48,894 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74. 2023-07-24 12:27:48,896 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=7ceaa4326cc6ecaed2b9a5b915e1eb74, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:48,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2. 2023-07-24 12:27:48,896 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2. 2023-07-24 12:27:48,896 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690201668896"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690201668896"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690201668896"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690201668896"}]},"ts":"1690201668896"} 2023-07-24 12:27:48,897 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=1bf83f930752d2d55b8cbd0f9855cec2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:48,898 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690201668897"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690201668897"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690201668897"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690201668897"}]},"ts":"1690201668897"} 2023-07-24 12:27:48,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 12:27:48,907 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-24 12:27:48,908 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 7ceaa4326cc6ecaed2b9a5b915e1eb74, server=jenkins-hbase6.apache.org,44275,1690201659331 in 264 msec 2023-07-24 12:27:48,910 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-24 12:27:48,910 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 1bf83f930752d2d55b8cbd0f9855cec2, server=jenkins-hbase6.apache.org,44517,1690201659253 in 268 msec 2023-07-24 12:27:48,910 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7ceaa4326cc6ecaed2b9a5b915e1eb74, ASSIGN in 432 msec 2023-07-24 12:27:48,913 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-24 12:27:48,913 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1bf83f930752d2d55b8cbd0f9855cec2, ASSIGN in 434 msec 2023-07-24 12:27:48,914 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 12:27:48,915 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201668914"}]},"ts":"1690201668914"} 2023-07-24 12:27:48,916 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-24 12:27:48,919 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 12:27:48,924 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-24 12:27:48,932 DEBUG [hconnection-0x23c47512-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:27:48,934 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:35484, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-24 12:27:48,943 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36595] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 12:27:48,978 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 12:27:48,978 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 12:27:48,978 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 12:27:48,978 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 12:27:48,979 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 12:27:48,985 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 12:27:48,985 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 12:27:48,985 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 12:27:48,985 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 12:27:48,988 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 705 msec 2023-07-24 12:27:49,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 12:27:49,403 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-24 12:27:49,407 DEBUG [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-24 12:27:49,408 DEBUG [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74. 2023-07-24 12:27:49,411 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 12:27:49,434 DEBUG [hconnection-0x3d003e3c-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:27:49,439 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:41400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:27:49,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1583): Client=jenkins//172.31.2.20 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 12:27:49,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690201669460 (current time:1690201669460). 2023-07-24 12:27:49,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 12:27:49,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(139): Connect 0x559cb8f9 to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:27:49,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@673cd78, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:27:49,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:27:49,473 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:35486, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:27:49,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x559cb8f9 to 127.0.0.1:49553 2023-07-24 12:27:49,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:27:49,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(139): Connect 0x37142497 to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:27:49,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1f3b2f81, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:27:49,581 DEBUG [hconnection-0x2f085d65-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:27:49,582 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:35494, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:27:49,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:27:49,588 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:33990, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:27:49,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37142497 to 127.0.0.1:49553 2023-07-24 12:27:49,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:27:49,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 12:27:49,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 12:27:49,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 12:27:49,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 12:27:49,653 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 12:27:49,654 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690202269654 2023-07-24 12:27:49,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 12:27:49,654 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-24 12:27:49,658 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 12:27:49,658 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 12:27:49,660 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 18 msec 2023-07-24 12:27:49,661 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 12:27:49,663 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 12:27:49,663 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 12:27:49,664 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690202269664 2023-07-24 12:27:49,711 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,712 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-24 12:27:49,712 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:27:49,713 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-24 12:27:49,713 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-24 12:27:49,714 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,714 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,718 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:27:49,718 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:27:49,718 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:27:49,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:27:49,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:27:49,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:27:49,718 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:49,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:27:49,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:27:49,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:27:49,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,719 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:49,719 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:49,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,719 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,719 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,719 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:49,720 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 12:27:49,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,720 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 12:27:49,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 12:27:49,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 12:27:49,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,720 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 12:27:49,721 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 12:27:49,720 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 12:27:49,724 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,724 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,724 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,726 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 12:27:49,726 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:27:49,726 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 12:27:49,727 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 12:27:49,727 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 12:27:49,727 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:27:49,728 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 12:27:49,727 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:27:49,729 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,36595,1690201659396' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 12:27:49,728 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 12:27:49,729 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 12:27:49,729 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44275,1690201659331' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 12:27:49,730 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 12:27:49,730 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 12:27:49,730 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44517,1690201659253' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 12:27:49,734 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:49,734 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:49,734 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,734 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:49,734 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:27:49,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:27:49,735 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,735 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:27:49,735 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,735 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:27:49,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:27:49,735 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,735 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:27:49,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:27:49,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:49,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:49,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:49,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:27:49,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,44517,1690201659253' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-24 12:27:49,740 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3be795a1[Count = 1] remaining members to acquire global barrier 2023-07-24 12:27:49,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:49,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:27:49,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:27:49,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:27:49,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:27:49,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:49,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:49,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:49,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:27:49,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,44275,1690201659331' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-24 12:27:49,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3be795a1[Count = 0] remaining members to acquire global barrier 2023-07-24 12:27:49,743 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-24 12:27:49,743 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,745 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,745 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,746 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,746 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 12:27:49,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,746 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 12:27:49,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,746 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:49,746 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 12:27:49,746 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 12:27:49,746 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase6.apache.org,36595,1690201659396' in zk 2023-07-24 12:27:49,747 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:49,747 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 12:27:49,747 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 12:27:49,747 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 12:27:49,748 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2. 2023-07-24 12:27:49,749 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 12:27:49,749 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:27:49,749 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 12:27:49,755 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 12:27:49,755 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2. started... 2023-07-24 12:27:49,755 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74. 2023-07-24 12:27:49,755 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 12:27:49,755 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74. started... 2023-07-24 12:27:49,758 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7ceaa4326cc6ecaed2b9a5b915e1eb74: 2023-07-24 12:27:49,759 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1bf83f930752d2d55b8cbd0f9855cec2: 2023-07-24 12:27:49,759 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,759 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,763 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:27:49,766 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 12:27:49,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 12:27:49,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:27:49,769 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 12:27:49,771 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 12:27:49,771 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 12:27:49,771 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 12:27:49,814 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74. completed. 2023-07-24 12:27:49,814 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74. 2023-07-24 12:27:49,816 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 12:27:49,818 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 12:27:49,819 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:49,819 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 12:27:49,819 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase6.apache.org,44275,1690201659331' in zk 2023-07-24 12:27:49,821 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2. completed. 2023-07-24 12:27:49,821 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2. 2023-07-24 12:27:49,822 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 12:27:49,822 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:27:49,822 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 12:27:49,822 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 12:27:49,823 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 12:27:49,823 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:49,823 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:49,823 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 12:27:49,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:49,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:27:49,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:27:49,823 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase6.apache.org,44517,1690201659253' in zk 2023-07-24 12:27:49,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:27:49,828 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 12:27:49,828 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:49,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:27:49,828 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:27:49,828 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 12:27:49,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:49,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:49,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:49,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:27:49,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:49,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:49,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:49,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase6.apache.org,44275,1690201659331': 2023-07-24 12:27:49,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,44275,1690201659331' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-24 12:27:49,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:49,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:27:49,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:27:49,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:27:49,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:27:49,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:49,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:49,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:49,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:27:49,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:49,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:49,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:49,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase6.apache.org,44517,1690201659253': 2023-07-24 12:27:49,839 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,44517,1690201659253' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-24 12:27:49,839 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-24 12:27:49,839 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 12:27:49,839 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 12:27:49,839 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,839 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 12:27:49,842 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,842 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:27:49,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:27:49,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,842 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:27:49,842 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,842 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,842 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:27:49,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:27:49,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,842 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:27:49,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:27:49,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:27:49,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:27:49,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:27:49,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:27:49,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:27:49,845 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:49,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,845 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:49,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:27:49,846 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:49,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:49,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:49,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:49,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:27:49,848 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:49,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,849 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:49,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:49,849 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:49,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:49,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:49,865 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:27:49,865 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:27:49,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:27:49,865 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:27:49,865 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:27:49,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:27:49,865 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:27:49,865 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:49,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:27:49,865 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:27:49,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:27:49,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:27:49,866 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:27:49,866 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:49,866 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:49,866 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,866 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:49,866 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:27:49,866 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,866 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,867 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-24 12:27:49,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:27:49,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:27:49,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:27:49,867 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:27:49,867 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:49,868 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:49,868 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,868 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:27:49,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:27:49,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 12:27:49,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 12:27:49,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,899 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:49,970 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:27:49,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 12:27:49,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:27:49,972 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 12:27:49,993 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:50,039 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-24 12:27:50,039 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:50,040 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 12:27:50,040 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690201669654Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1690201669896 (+242 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1690201669896Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1690201669896Writing data manifest for emptySnaptb0-testExportWithTargetName at 1690201669923 (+27 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1690201669979 (+56 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690201670039 (+60 ms) 2023-07-24 12:27:50,043 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 12:27:50,045 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 387 msec 2023-07-24 12:27:50,272 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:27:50,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 12:27:50,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 12:27:50,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44275] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 12:27:50,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44517] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 12:27:50,301 DEBUG [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-24 12:27:50,301 DEBUG [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74. 2023-07-24 12:27:50,302 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 12:27:50,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1583): Client=jenkins//172.31.2.20 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 12:27:50,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690201670323 (current time:1690201670323). 2023-07-24 12:27:50,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 12:27:50,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(139): Connect 0x4ead9bf9 to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:27:50,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5835aa21, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:27:50,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:27:50,340 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:35496, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:27:50,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ead9bf9 to 127.0.0.1:49553 2023-07-24 12:27:50,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:27:50,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(139): Connect 0x55677ca2 to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:27:50,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77b747a4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:27:50,376 DEBUG [hconnection-0x2268fd1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:27:50,380 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:35512, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:27:50,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:27:50,389 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:33998, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:27:50,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55677ca2 to 127.0.0.1:49553 2023-07-24 12:27:50,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:27:50,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 12:27:50,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 12:27:50,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 12:27:50,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 12:27:50,399 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 12:27:50,402 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690202270402 2023-07-24 12:27:50,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 12:27:50,403 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-24 12:27:50,408 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 12:27:50,408 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 12:27:50,409 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 12:27:50,410 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 12:27:50,412 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-07-24 12:27:50,413 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 12:27:50,414 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690202270414 2023-07-24 12:27:50,455 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-24 12:27:50,455 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-24 12:27:50,455 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:27:50,457 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-24 12:27:50,457 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-24 12:27:50,458 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,458 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,460 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:50,460 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:27:50,460 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:27:50,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:27:50,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:27:50,460 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:27:50,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:27:50,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:27:50,460 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:27:50,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:27:50,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,461 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,461 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,462 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:50,462 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:50,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 12:27:50,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 12:27:50,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,462 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,462 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 12:27:50,462 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 12:27:50,463 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:50,463 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 12:27:50,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 12:27:50,463 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 12:27:50,463 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 12:27:50,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,463 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 12:27:50,463 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 12:27:50,463 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 12:27:50,463 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:27:50,463 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:27:50,463 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 12:27:50,476 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 12:27:50,477 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 12:27:50,477 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,36595,1690201659396' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 12:27:50,476 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 12:27:50,477 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 12:27:50,477 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 12:27:50,477 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44517,1690201659253' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 12:27:50,477 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:27:50,478 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 12:27:50,478 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 12:27:50,478 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44275,1690201659331' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 12:27:50,481 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,482 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:50,482 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:50,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:27:50,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:27:50,483 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,483 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:27:50,484 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,484 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:27:50,483 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:50,484 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,484 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:27:50,484 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:27:50,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:27:50,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 12:27:50,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:50,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:50,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:27:50,486 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,44517,1690201659253' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-24 12:27:50,486 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@519ea3f1[Count = 1] remaining members to acquire global barrier 2023-07-24 12:27:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:27:50,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:27:50,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:27:50,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:27:50,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 12:27:50,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:50,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:50,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:50,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:27:50,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,44275,1690201659331' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-24 12:27:50,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@519ea3f1[Count = 0] remaining members to acquire global barrier 2023-07-24 12:27:50,491 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-24 12:27:50,491 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,497 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,497 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,497 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,497 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 12:27:50,497 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 12:27:50,497 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase6.apache.org,36595,1690201659396' in zk 2023-07-24 12:27:50,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,497 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 12:27:50,497 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:50,497 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 12:27:50,498 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 12:27:50,498 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 12:27:50,498 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74. 2023-07-24 12:27:50,498 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 12:27:50,498 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 12:27:50,498 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2. 2023-07-24 12:27:50,498 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:50,498 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2. started... 2023-07-24 12:27:50,498 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 12:27:50,498 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74. started... 2023-07-24 12:27:50,498 INFO [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7ceaa4326cc6ecaed2b9a5b915e1eb74 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-24 12:27:50,498 INFO [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 1bf83f930752d2d55b8cbd0f9855cec2 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-24 12:27:50,500 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 12:27:50,500 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:27:50,500 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 12:27:50,508 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:27:50,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 12:27:50,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:27:50,510 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 12:27:50,667 INFO [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072470becac3be524721b3d739d78a0ebd88 to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023072470becac3be524721b3d739d78a0ebd88 2023-07-24 12:27:50,667 INFO [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230724b6847ed28b10438a8dbba3b524f22e24 to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230724b6847ed28b10438a8dbba3b524f22e24 2023-07-24 12:27:50,710 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:27:50,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 12:27:50,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:27:50,734 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 12:27:50,764 INFO [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportWithTargetName/7ceaa4326cc6ecaed2b9a5b915e1eb74/.tmp/cf/a5fd147c543147e0a05d2ddf2fc751b4 2023-07-24 12:27:50,778 INFO [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportWithTargetName/1bf83f930752d2d55b8cbd0f9855cec2/.tmp/cf/c18d72cbfa064e38a88befe0be3aa9d5 2023-07-24 12:27:50,786 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportWithTargetName/7ceaa4326cc6ecaed2b9a5b915e1eb74/.tmp/cf/a5fd147c543147e0a05d2ddf2fc751b4 as hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportWithTargetName/7ceaa4326cc6ecaed2b9a5b915e1eb74/cf/a5fd147c543147e0a05d2ddf2fc751b4 2023-07-24 12:27:50,794 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportWithTargetName/1bf83f930752d2d55b8cbd0f9855cec2/.tmp/cf/c18d72cbfa064e38a88befe0be3aa9d5 as hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportWithTargetName/1bf83f930752d2d55b8cbd0f9855cec2/cf/c18d72cbfa064e38a88befe0be3aa9d5 2023-07-24 12:27:50,804 INFO [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportWithTargetName/7ceaa4326cc6ecaed2b9a5b915e1eb74/cf/a5fd147c543147e0a05d2ddf2fc751b4, entries=6, sequenceid=6, filesize=5.9 K 2023-07-24 12:27:50,829 INFO [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 7ceaa4326cc6ecaed2b9a5b915e1eb74 in 331ms, sequenceid=6, compaction requested=false 2023-07-24 12:27:50,830 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-24 12:27:50,831 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7ceaa4326cc6ecaed2b9a5b915e1eb74: 2023-07-24 12:27:50,832 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 12:27:50,832 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 12:27:50,832 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportWithTargetName/7ceaa4326cc6ecaed2b9a5b915e1eb74/cf/a5fd147c543147e0a05d2ddf2fc751b4] hfiles 2023-07-24 12:27:50,832 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportWithTargetName/7ceaa4326cc6ecaed2b9a5b915e1eb74/cf/a5fd147c543147e0a05d2ddf2fc751b4 for snapshot=snaptb0-testExportWithTargetName 2023-07-24 12:27:50,840 INFO [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportWithTargetName/1bf83f930752d2d55b8cbd0f9855cec2/cf/c18d72cbfa064e38a88befe0be3aa9d5, entries=44, sequenceid=6, filesize=12.3 K 2023-07-24 12:27:50,846 INFO [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 1bf83f930752d2d55b8cbd0f9855cec2 in 348ms, sequenceid=6, compaction requested=false 2023-07-24 12:27:50,847 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 1bf83f930752d2d55b8cbd0f9855cec2: 2023-07-24 12:27:50,847 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 12:27:50,848 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 12:27:50,848 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportWithTargetName/1bf83f930752d2d55b8cbd0f9855cec2/cf/c18d72cbfa064e38a88befe0be3aa9d5] hfiles 2023-07-24 12:27:50,848 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportWithTargetName/1bf83f930752d2d55b8cbd0f9855cec2/cf/c18d72cbfa064e38a88befe0be3aa9d5 for snapshot=snaptb0-testExportWithTargetName 2023-07-24 12:27:50,876 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74. completed. 2023-07-24 12:27:50,877 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74. 2023-07-24 12:27:50,877 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 12:27:50,877 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 12:27:50,877 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:50,877 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 12:27:50,877 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase6.apache.org,44275,1690201659331' in zk 2023-07-24 12:27:50,885 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 12:27:50,885 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:50,885 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:27:50,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:50,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:27:50,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:27:50,885 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 12:27:50,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:27:50,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:27:50,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 12:27:50,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:50,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:50,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:50,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:27:50,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 12:27:50,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:50,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:50,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase6.apache.org,44275,1690201659331': 2023-07-24 12:27:50,894 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,44275,1690201659331' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-24 12:27:50,896 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2. completed. 2023-07-24 12:27:50,896 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2. 2023-07-24 12:27:50,897 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 12:27:50,897 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 12:27:50,897 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:50,897 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 12:27:50,897 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase6.apache.org,44517,1690201659253' in zk 2023-07-24 12:27:50,899 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:50,899 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 12:27:50,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:50,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:27:50,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:27:50,899 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:27:50,899 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 12:27:50,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:27:50,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:27:50,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 12:27:50,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:50,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:50,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:50,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:27:50,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 12:27:50,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:50,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:50,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:50,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase6.apache.org,44517,1690201659253': 2023-07-24 12:27:50,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,44517,1690201659253' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-24 12:27:50,908 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-24 12:27:50,908 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 12:27:50,908 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 12:27:50,908 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-24 12:27:50,908 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 12:27:50,910 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,910 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,910 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:27:50,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,911 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,911 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:27:50,911 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,910 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:27:50,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:27:50,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:27:50,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:27:50,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:27:50,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:27:50,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:27:50,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:27:50,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:27:50,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:27:50,914 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:50,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 12:27:50,915 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:50,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:27:50,917 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:50,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 12:27:50,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:50,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:50,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:50,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:27:50,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 12:27:50,923 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:50,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:50,923 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:50,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:50,924 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:50,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:50,942 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:50,942 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,942 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:27:50,942 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:27:50,942 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:50,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:27:50,942 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:27:50,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:27:50,943 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:27:50,943 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:27:50,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:27:50,943 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-24 12:27:50,943 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-24 12:27:50,943 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 12:27:50,943 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 12:27:50,943 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:27:50,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:27:50,942 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:50,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:27:50,942 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:27:50,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:27:50,944 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:27:50,943 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:27:50,944 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:27:50,944 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,944 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:27:50,944 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:27:50,944 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,944 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 12:27:50,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:27:50,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:27:50,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:27:50,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:27:50,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023072470becac3be524721b3d739d78a0ebd88, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230724b6847ed28b10438a8dbba3b524f22e24] mob files 2023-07-24 12:27:50,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023072470becac3be524721b3d739d78a0ebd88 2023-07-24 12:27:50,946 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230724b6847ed28b10438a8dbba3b524f22e24 2023-07-24 12:27:50,991 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-24 12:27:50,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 12:27:51,034 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:27:51,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 12:27:51,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:27:51,037 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 12:27:51,050 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-24 12:27:51,089 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-24 12:27:51,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 12:27:51,090 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 12:27:51,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690201670403Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1690201670991 (+588 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1690201670991Loading Region manifests for snaptb0-testExportWithTargetName at 1690201670991Writing data manifest for snaptb0-testExportWithTargetName at 1690201671000 (+9 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1690201671034 (+34 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690201671089 (+55 ms) 2023-07-24 12:27:51,092 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 12:27:51,094 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 687 msec 2023-07-24 12:27:51,537 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:27:51,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 12:27:51,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 12:27:51,541 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201671541 2023-07-24 12:27:51,541 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42387, tgtDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201671541, rawTgtDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201671541, srcFsUri=hdfs://localhost:42387, srcDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa 2023-07-24 12:27:51,592 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42387, inputRoot=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa 2023-07-24 12:27:51,592 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_681475080_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201671541, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201671541/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-24 12:27:51,592 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42387, inputRoot=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa, snapshotDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-24 12:27:51,628 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201671541/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-24 12:27:52,152 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 12:27:52,153 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 12:27:52,153 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 12:27:52,154 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 12:27:52,154 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 12:27:52,155 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 12:27:52,155 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 12:27:52,256 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/hadoop-5324149863914323582.jar 2023-07-24 12:27:52,257 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 12:27:52,257 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 12:27:52,258 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 12:27:52,258 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 12:27:52,259 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 12:27:52,259 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 12:27:52,260 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 12:27:52,260 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 12:27:52,261 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 12:27:52,261 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 12:27:52,262 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 12:27:52,262 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 12:27:52,263 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 12:27:52,263 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 12:27:52,264 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 12:27:52,265 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 12:27:52,268 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:27:52,268 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:27:52,268 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 12:27:52,269 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:27:52,269 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:27:52,269 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 12:27:52,270 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 12:27:53,313 WARN [Listener at jenkins-hbase6.apache.org/41373] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 12:27:53,320 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-24 12:27:53,331 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-24 12:27:54,312 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 12:27:54,324 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 12:27:54,324 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 12:27:54,978 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0001_000001 (auth:SIMPLE) 2023-07-24 12:27:59,958 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0001_000001 (auth:SIMPLE) 2023-07-24 12:28:02,231 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0001_000001 (auth:SIMPLE) 2023-07-24 12:28:05,948 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0001_000001 (auth:SIMPLE) 2023-07-24 12:28:07,716 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 12:28:07,718 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 12:28:07,730 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-24 12:28:07,730 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 12:28:07,732 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 12:28:07,732 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1338397176_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-24 12:28:07,733 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-24 12:28:07,733 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-24 12:28:07,733 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1338397176_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201671541/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201671541/.hbase-snapshot/testExportWithTargetName 2023-07-24 12:28:07,734 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201671541/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-24 12:28:07,734 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201671541/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-24 12:28:07,745 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-24 12:28:07,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.HMaster$11(2418): Client=jenkins//172.31.2.20 disable testtb-testExportWithTargetName 2023-07-24 12:28:07,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-24 12:28:07,762 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201687762"}]},"ts":"1690201687762"} 2023-07-24 12:28:07,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 12:28:07,764 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-24 12:28:07,765 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-24 12:28:07,767 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7ceaa4326cc6ecaed2b9a5b915e1eb74, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1bf83f930752d2d55b8cbd0f9855cec2, UNASSIGN}] 2023-07-24 12:28:07,769 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7ceaa4326cc6ecaed2b9a5b915e1eb74, UNASSIGN 2023-07-24 12:28:07,769 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1bf83f930752d2d55b8cbd0f9855cec2, UNASSIGN 2023-07-24 12:28:07,770 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=7ceaa4326cc6ecaed2b9a5b915e1eb74, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:07,770 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=1bf83f930752d2d55b8cbd0f9855cec2, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:07,770 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690201687770"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201687770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201687770"}]},"ts":"1690201687770"} 2023-07-24 12:28:07,770 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690201687770"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201687770"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201687770"}]},"ts":"1690201687770"} 2023-07-24 12:28:07,772 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 7ceaa4326cc6ecaed2b9a5b915e1eb74, server=jenkins-hbase6.apache.org,44275,1690201659331}] 2023-07-24 12:28:07,772 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 1bf83f930752d2d55b8cbd0f9855cec2, server=jenkins-hbase6.apache.org,44517,1690201659253}] 2023-07-24 12:28:07,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 12:28:07,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(111): Close 1bf83f930752d2d55b8cbd0f9855cec2 2023-07-24 12:28:07,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(111): Close 7ceaa4326cc6ecaed2b9a5b915e1eb74 2023-07-24 12:28:07,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 1bf83f930752d2d55b8cbd0f9855cec2, disabling compactions & flushes 2023-07-24 12:28:07,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 7ceaa4326cc6ecaed2b9a5b915e1eb74, disabling compactions & flushes 2023-07-24 12:28:07,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2. 2023-07-24 12:28:07,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74. 2023-07-24 12:28:07,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2. 2023-07-24 12:28:07,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74. 2023-07-24 12:28:07,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2. after waiting 0 ms 2023-07-24 12:28:07,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2. 2023-07-24 12:28:07,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74. after waiting 0 ms 2023-07-24 12:28:07,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74. 2023-07-24 12:28:07,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportWithTargetName/1bf83f930752d2d55b8cbd0f9855cec2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 12:28:07,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 12:28:07,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportWithTargetName/7ceaa4326cc6ecaed2b9a5b915e1eb74/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 12:28:07,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2. 2023-07-24 12:28:07,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 1bf83f930752d2d55b8cbd0f9855cec2: 2023-07-24 12:28:07,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 12:28:07,990 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(149): Closed 1bf83f930752d2d55b8cbd0f9855cec2 2023-07-24 12:28:07,991 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74. 2023-07-24 12:28:07,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 7ceaa4326cc6ecaed2b9a5b915e1eb74: 2023-07-24 12:28:07,992 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=1bf83f930752d2d55b8cbd0f9855cec2, regionState=CLOSED 2023-07-24 12:28:07,992 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690201687992"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201687992"}]},"ts":"1690201687992"} 2023-07-24 12:28:07,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(149): Closed 7ceaa4326cc6ecaed2b9a5b915e1eb74 2023-07-24 12:28:07,998 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=7ceaa4326cc6ecaed2b9a5b915e1eb74, regionState=CLOSED 2023-07-24 12:28:07,998 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690201687998"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201687998"}]},"ts":"1690201687998"} 2023-07-24 12:28:08,002 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-24 12:28:08,002 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 1bf83f930752d2d55b8cbd0f9855cec2, server=jenkins-hbase6.apache.org,44517,1690201659253 in 224 msec 2023-07-24 12:28:08,008 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=1bf83f930752d2d55b8cbd0f9855cec2, UNASSIGN in 235 msec 2023-07-24 12:28:08,008 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-24 12:28:08,008 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 7ceaa4326cc6ecaed2b9a5b915e1eb74, server=jenkins-hbase6.apache.org,44275,1690201659331 in 228 msec 2023-07-24 12:28:08,011 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-24 12:28:08,011 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=7ceaa4326cc6ecaed2b9a5b915e1eb74, UNASSIGN in 241 msec 2023-07-24 12:28:08,012 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201688011"}]},"ts":"1690201688011"} 2023-07-24 12:28:08,013 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-24 12:28:08,015 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-24 12:28:08,018 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 264 msec 2023-07-24 12:28:08,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 12:28:08,074 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-24 12:28:08,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.HMaster$5(2228): Client=jenkins//172.31.2.20 delete testtb-testExportWithTargetName 2023-07-24 12:28:08,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 12:28:08,088 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 12:28:08,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-24 12:28:08,090 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 12:28:08,093 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36595] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-24 12:28:08,096 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportWithTargetName/7ceaa4326cc6ecaed2b9a5b915e1eb74 2023-07-24 12:28:08,096 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportWithTargetName/1bf83f930752d2d55b8cbd0f9855cec2 2023-07-24 12:28:08,096 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 12:28:08,096 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 12:28:08,096 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 12:28:08,096 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 12:28:08,098 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:28:08,098 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:28:08,098 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:28:08,098 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 12:28:08,098 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 12:28:08,098 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 12:28:08,098 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 12:28:08,098 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:28:08,098 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 12:28:08,098 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 12:28:08,099 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 12:28:08,099 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 12:28:08,101 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportWithTargetName/1bf83f930752d2d55b8cbd0f9855cec2/cf, FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportWithTargetName/1bf83f930752d2d55b8cbd0f9855cec2/recovered.edits] 2023-07-24 12:28:08,101 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportWithTargetName/7ceaa4326cc6ecaed2b9a5b915e1eb74/cf, FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportWithTargetName/7ceaa4326cc6ecaed2b9a5b915e1eb74/recovered.edits] 2023-07-24 12:28:08,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-24 12:28:08,108 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportWithTargetName/7ceaa4326cc6ecaed2b9a5b915e1eb74/cf/a5fd147c543147e0a05d2ddf2fc751b4 to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportWithTargetName/7ceaa4326cc6ecaed2b9a5b915e1eb74/cf/a5fd147c543147e0a05d2ddf2fc751b4 2023-07-24 12:28:08,108 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportWithTargetName/1bf83f930752d2d55b8cbd0f9855cec2/cf/c18d72cbfa064e38a88befe0be3aa9d5 to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportWithTargetName/1bf83f930752d2d55b8cbd0f9855cec2/cf/c18d72cbfa064e38a88befe0be3aa9d5 2023-07-24 12:28:08,112 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportWithTargetName/1bf83f930752d2d55b8cbd0f9855cec2/recovered.edits/9.seqid to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportWithTargetName/1bf83f930752d2d55b8cbd0f9855cec2/recovered.edits/9.seqid 2023-07-24 12:28:08,112 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportWithTargetName/7ceaa4326cc6ecaed2b9a5b915e1eb74/recovered.edits/9.seqid to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportWithTargetName/7ceaa4326cc6ecaed2b9a5b915e1eb74/recovered.edits/9.seqid 2023-07-24 12:28:08,112 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportWithTargetName/1bf83f930752d2d55b8cbd0f9855cec2 2023-07-24 12:28:08,112 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportWithTargetName/7ceaa4326cc6ecaed2b9a5b915e1eb74 2023-07-24 12:28:08,113 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-24 12:28:08,113 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-24 12:28:08,114 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-24 12:28:08,118 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023072470becac3be524721b3d739d78a0ebd88 to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023072470becac3be524721b3d739d78a0ebd88 2023-07-24 12:28:08,119 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230724b6847ed28b10438a8dbba3b524f22e24 to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230724b6847ed28b10438a8dbba3b524f22e24 2023-07-24 12:28:08,119 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-24 12:28:08,122 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 12:28:08,142 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-24 12:28:08,144 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-24 12:28:08,146 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 12:28:08,146 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-24 12:28:08,146 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690201688146"}]},"ts":"9223372036854775807"} 2023-07-24 12:28:08,146 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690201688146"}]},"ts":"9223372036854775807"} 2023-07-24 12:28:08,148 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 12:28:08,148 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7ceaa4326cc6ecaed2b9a5b915e1eb74, NAME => 'testtb-testExportWithTargetName,,1690201668280.7ceaa4326cc6ecaed2b9a5b915e1eb74.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 1bf83f930752d2d55b8cbd0f9855cec2, NAME => 'testtb-testExportWithTargetName,1,1690201668280.1bf83f930752d2d55b8cbd0f9855cec2.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 12:28:08,148 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-24 12:28:08,148 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690201688148"}]},"ts":"9223372036854775807"} 2023-07-24 12:28:08,150 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-24 12:28:08,152 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 12:28:08,154 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 72 msec 2023-07-24 12:28:08,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-24 12:28:08,204 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-24 12:28:08,221 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(751): Client=jenkins//172.31.2.20 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-24 12:28:08,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-24 12:28:08,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(751): Client=jenkins//172.31.2.20 delete name: "snaptb0-testExportWithTargetName" 2023-07-24 12:28:08,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-24 12:28:08,257 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=754 (was 704) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1770457043_1 at /127.0.0.1:47262 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1338397176_17 at /127.0.0.1:47294 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4f8b35dd-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/cluster_6ecbaa8a-c107-3c9f-ccef-7cf56d65ce13/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/cluster_6ecbaa8a-c107-3c9f-ccef-7cf56d65ce13/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4f8b35dd-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase6.apache.org/172.31.2.20:41373 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/cluster_6ecbaa8a-c107-3c9f-ccef-7cf56d65ce13/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/cluster_6ecbaa8a-c107-3c9f-ccef-7cf56d65ce13/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4f8b35dd-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4f8b35dd-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1770457043_1 at /127.0.0.1:39356 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1338397176_17 at /127.0.0.1:47302 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase6.apache.org/172.31.2.20:34879 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1338397176_17 at /127.0.0.1:39370 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/cluster_6ecbaa8a-c107-3c9f-ccef-7cf56d65ce13/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1315 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase6.apache.org/172.31.2.20:38881 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/cluster_6ecbaa8a-c107-3c9f-ccef-7cf56d65ce13/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=938 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=283 (was 266) - SystemLoadAverage LEAK? -, ProcessCount=176 (was 171) - ProcessCount LEAK? -, AvailableMemoryMB=830 (was 454) - AvailableMemoryMB LEAK? - 2023-07-24 12:28:08,258 WARN [Listener at jenkins-hbase6.apache.org/41373] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-07-24 12:28:08,277 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=754, OpenFileDescriptor=938, MaxFileDescriptor=60000, SystemLoadAverage=283, ProcessCount=176, AvailableMemoryMB=829 2023-07-24 12:28:08,277 WARN [Listener at jenkins-hbase6.apache.org/41373] hbase.ResourceChecker(130): Thread=754 is superior to 500 2023-07-24 12:28:08,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.HMaster$4(2112): Client=jenkins//172.31.2.20 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 12:28:08,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-24 12:28:08,283 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 12:28:08,284 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(700): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-24 12:28:08,285 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 12:28:08,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 12:28:08,288 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemState/a752ae27b310a6ef5c5909d0b0256d79 2023-07-24 12:28:08,288 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemState/50d12b51b8388ce3f4d92a330f280c2f 2023-07-24 12:28:08,288 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemState/a752ae27b310a6ef5c5909d0b0256d79 empty. 2023-07-24 12:28:08,288 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemState/50d12b51b8388ce3f4d92a330f280c2f empty. 2023-07-24 12:28:08,289 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemState/a752ae27b310a6ef5c5909d0b0256d79 2023-07-24 12:28:08,289 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemState/50d12b51b8388ce3f4d92a330f280c2f 2023-07-24 12:28:08,289 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-24 12:28:08,303 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-24 12:28:08,304 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => a752ae27b310a6ef5c5909d0b0256d79, NAME => 'testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp 2023-07-24 12:28:08,304 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 50d12b51b8388ce3f4d92a330f280c2f, NAME => 'testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp 2023-07-24 12:28:08,320 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:28:08,321 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing a752ae27b310a6ef5c5909d0b0256d79, disabling compactions & flushes 2023-07-24 12:28:08,321 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79. 2023-07-24 12:28:08,321 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79. 2023-07-24 12:28:08,321 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79. after waiting 0 ms 2023-07-24 12:28:08,321 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79. 2023-07-24 12:28:08,321 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79. 2023-07-24 12:28:08,321 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for a752ae27b310a6ef5c5909d0b0256d79: 2023-07-24 12:28:08,321 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:28:08,322 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 50d12b51b8388ce3f4d92a330f280c2f, disabling compactions & flushes 2023-07-24 12:28:08,322 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f. 2023-07-24 12:28:08,322 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f. 2023-07-24 12:28:08,322 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f. after waiting 0 ms 2023-07-24 12:28:08,322 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f. 2023-07-24 12:28:08,322 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f. 2023-07-24 12:28:08,322 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 50d12b51b8388ce3f4d92a330f280c2f: 2023-07-24 12:28:08,324 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 12:28:08,326 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690201688325"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201688325"}]},"ts":"1690201688325"} 2023-07-24 12:28:08,326 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690201688325"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201688325"}]},"ts":"1690201688325"} 2023-07-24 12:28:08,328 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 12:28:08,329 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 12:28:08,329 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201688329"}]},"ts":"1690201688329"} 2023-07-24 12:28:08,331 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-24 12:28:08,337 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-07-24 12:28:08,339 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 12:28:08,339 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 12:28:08,339 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 12:28:08,339 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 12:28:08,339 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a752ae27b310a6ef5c5909d0b0256d79, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=50d12b51b8388ce3f4d92a330f280c2f, ASSIGN}] 2023-07-24 12:28:08,342 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a752ae27b310a6ef5c5909d0b0256d79, ASSIGN 2023-07-24 12:28:08,342 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=50d12b51b8388ce3f4d92a330f280c2f, ASSIGN 2023-07-24 12:28:08,344 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a752ae27b310a6ef5c5909d0b0256d79, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,36595,1690201659396; forceNewPlan=false, retain=false 2023-07-24 12:28:08,344 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=50d12b51b8388ce3f4d92a330f280c2f, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,44275,1690201659331; forceNewPlan=false, retain=false 2023-07-24 12:28:08,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 12:28:08,494 INFO [jenkins-hbase6:38215] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 12:28:08,497 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=a752ae27b310a6ef5c5909d0b0256d79, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:08,497 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=50d12b51b8388ce3f4d92a330f280c2f, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:08,497 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690201688497"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201688497"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201688497"}]},"ts":"1690201688497"} 2023-07-24 12:28:08,497 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690201688497"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201688497"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201688497"}]},"ts":"1690201688497"} 2023-07-24 12:28:08,499 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure a752ae27b310a6ef5c5909d0b0256d79, server=jenkins-hbase6.apache.org,36595,1690201659396}] 2023-07-24 12:28:08,501 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 50d12b51b8388ce3f4d92a330f280c2f, server=jenkins-hbase6.apache.org,44275,1690201659331}] 2023-07-24 12:28:08,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 12:28:08,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79. 2023-07-24 12:28:08,661 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f. 2023-07-24 12:28:08,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a752ae27b310a6ef5c5909d0b0256d79, NAME => 'testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 12:28:08,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 50d12b51b8388ce3f4d92a330f280c2f, NAME => 'testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 12:28:08,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79. service=AccessControlService 2023-07-24 12:28:08,661 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 12:28:08,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f. service=AccessControlService 2023-07-24 12:28:08,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState a752ae27b310a6ef5c5909d0b0256d79 2023-07-24 12:28:08,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:28:08,662 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 12:28:08,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for a752ae27b310a6ef5c5909d0b0256d79 2023-07-24 12:28:08,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for a752ae27b310a6ef5c5909d0b0256d79 2023-07-24 12:28:08,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 50d12b51b8388ce3f4d92a330f280c2f 2023-07-24 12:28:08,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:28:08,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 50d12b51b8388ce3f4d92a330f280c2f 2023-07-24 12:28:08,662 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 50d12b51b8388ce3f4d92a330f280c2f 2023-07-24 12:28:08,668 INFO [StoreOpener-a752ae27b310a6ef5c5909d0b0256d79-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a752ae27b310a6ef5c5909d0b0256d79 2023-07-24 12:28:08,668 INFO [StoreOpener-50d12b51b8388ce3f4d92a330f280c2f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 50d12b51b8388ce3f4d92a330f280c2f 2023-07-24 12:28:08,669 DEBUG [StoreOpener-a752ae27b310a6ef5c5909d0b0256d79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemState/a752ae27b310a6ef5c5909d0b0256d79/cf 2023-07-24 12:28:08,669 DEBUG [StoreOpener-a752ae27b310a6ef5c5909d0b0256d79-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemState/a752ae27b310a6ef5c5909d0b0256d79/cf 2023-07-24 12:28:08,669 DEBUG [StoreOpener-50d12b51b8388ce3f4d92a330f280c2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemState/50d12b51b8388ce3f4d92a330f280c2f/cf 2023-07-24 12:28:08,669 DEBUG [StoreOpener-50d12b51b8388ce3f4d92a330f280c2f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemState/50d12b51b8388ce3f4d92a330f280c2f/cf 2023-07-24 12:28:08,670 INFO [StoreOpener-50d12b51b8388ce3f4d92a330f280c2f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 50d12b51b8388ce3f4d92a330f280c2f columnFamilyName cf 2023-07-24 12:28:08,670 INFO [StoreOpener-a752ae27b310a6ef5c5909d0b0256d79-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a752ae27b310a6ef5c5909d0b0256d79 columnFamilyName cf 2023-07-24 12:28:08,672 INFO [StoreOpener-50d12b51b8388ce3f4d92a330f280c2f-1] regionserver.HStore(310): Store=50d12b51b8388ce3f4d92a330f280c2f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 12:28:08,673 INFO [StoreOpener-a752ae27b310a6ef5c5909d0b0256d79-1] regionserver.HStore(310): Store=a752ae27b310a6ef5c5909d0b0256d79/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 12:28:08,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemState/50d12b51b8388ce3f4d92a330f280c2f 2023-07-24 12:28:08,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemState/a752ae27b310a6ef5c5909d0b0256d79 2023-07-24 12:28:08,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemState/50d12b51b8388ce3f4d92a330f280c2f 2023-07-24 12:28:08,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemState/a752ae27b310a6ef5c5909d0b0256d79 2023-07-24 12:28:08,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 50d12b51b8388ce3f4d92a330f280c2f 2023-07-24 12:28:08,679 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for a752ae27b310a6ef5c5909d0b0256d79 2023-07-24 12:28:08,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemState/a752ae27b310a6ef5c5909d0b0256d79/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 12:28:08,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemState/50d12b51b8388ce3f4d92a330f280c2f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 12:28:08,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened a752ae27b310a6ef5c5909d0b0256d79; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74756472, jitterRate=0.11395823955535889}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 12:28:08,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for a752ae27b310a6ef5c5909d0b0256d79: 2023-07-24 12:28:08,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 50d12b51b8388ce3f4d92a330f280c2f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68261747, jitterRate=0.017179295420646667}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 12:28:08,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 50d12b51b8388ce3f4d92a330f280c2f: 2023-07-24 12:28:08,683 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79., pid=30, masterSystemTime=1690201688652 2023-07-24 12:28:08,683 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f., pid=31, masterSystemTime=1690201688654 2023-07-24 12:28:08,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f. 2023-07-24 12:28:08,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f. 2023-07-24 12:28:08,686 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=50d12b51b8388ce3f4d92a330f280c2f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:08,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79. 2023-07-24 12:28:08,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79. 2023-07-24 12:28:08,686 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690201688686"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690201688686"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690201688686"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690201688686"}]},"ts":"1690201688686"} 2023-07-24 12:28:08,687 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=a752ae27b310a6ef5c5909d0b0256d79, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:08,687 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690201688687"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690201688687"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690201688687"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690201688687"}]},"ts":"1690201688687"} 2023-07-24 12:28:08,692 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-24 12:28:08,699 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 50d12b51b8388ce3f4d92a330f280c2f, server=jenkins-hbase6.apache.org,44275,1690201659331 in 187 msec 2023-07-24 12:28:08,700 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-24 12:28:08,700 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure a752ae27b310a6ef5c5909d0b0256d79, server=jenkins-hbase6.apache.org,36595,1690201659396 in 191 msec 2023-07-24 12:28:08,701 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=50d12b51b8388ce3f4d92a330f280c2f, ASSIGN in 360 msec 2023-07-24 12:28:08,702 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-24 12:28:08,702 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a752ae27b310a6ef5c5909d0b0256d79, ASSIGN in 361 msec 2023-07-24 12:28:08,703 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 12:28:08,704 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201688703"}]},"ts":"1690201688703"} 2023-07-24 12:28:08,706 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-24 12:28:08,710 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 12:28:08,711 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-24 12:28:08,713 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36595] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 12:28:08,714 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:28:08,714 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:28:08,714 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:28:08,714 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:28:08,716 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 12:28:08,716 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 12:28:08,716 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 12:28:08,716 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 12:28:08,718 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 436 msec 2023-07-24 12:28:08,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 12:28:08,888 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-24 12:28:08,891 DEBUG [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-24 12:28:08,891 DEBUG [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79. 2023-07-24 12:28:08,894 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 12:28:08,904 DEBUG [hconnection-0x3d003e3c-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:28:08,909 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:53590, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:28:08,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1583): Client=jenkins//172.31.2.20 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 12:28:08,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690201688914 (current time:1690201688914). 2023-07-24 12:28:08,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 12:28:08,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(139): Connect 0x48fcc1a0 to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:28:08,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48218484, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:28:08,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:28:08,981 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:59204, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:28:08,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x48fcc1a0 to 127.0.0.1:49553 2023-07-24 12:28:08,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:28:08,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(139): Connect 0x2920dbdc to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:28:09,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77fee99, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:28:09,049 DEBUG [hconnection-0x43be5f56-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:28:09,053 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:59210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:28:09,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:28:09,061 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:53600, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:28:09,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2920dbdc to 127.0.0.1:49553 2023-07-24 12:28:09,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:28:09,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 12:28:09,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 12:28:09,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 12:28:09,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 12:28:09,070 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 12:28:09,071 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690202289071 2023-07-24 12:28:09,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 12:28:09,072 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-24 12:28:09,073 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 12:28:09,073 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 12:28:09,076 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 12:28:09,076 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 12:28:09,078 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-24 12:28:09,079 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 12:28:09,080 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690202289080 2023-07-24 12:28:09,095 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,095 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-24 12:28:09,096 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:28:09,097 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-24 12:28:09,097 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-24 12:28:09,124 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,124 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,161 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:09,161 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:09,161 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:09,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:09,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:09,161 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:09,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:09,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:09,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:09,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:09,162 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:09,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,162 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:09,163 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,163 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,163 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:09,163 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 12:28:09,163 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 12:28:09,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 12:28:09,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,163 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 12:28:09,163 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 12:28:09,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 12:28:09,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,163 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 12:28:09,164 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,164 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,164 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 12:28:09,164 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 12:28:09,164 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,164 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:28:09,164 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 12:28:09,165 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 12:28:09,165 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 12:28:09,164 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:28:09,165 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44275,1690201659331' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 12:28:09,166 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 12:28:09,166 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 12:28:09,167 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44517,1690201659253' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 12:28:09,165 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:28:09,168 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 12:28:09,168 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 12:28:09,168 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,36595,1690201659396' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 12:28:09,173 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:28:09,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 12:28:09,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:28:09,174 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 12:28:09,258 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,258 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,258 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:09,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:09,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:09,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:09,292 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:09,292 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,292 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,292 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:09,292 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:28:09,292 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:28:09,293 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,293 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:28:09,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:09,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:09,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:09,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:09,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:09,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,44275,1690201659331' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-24 12:28:09,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@215afab2[Count = 1] remaining members to acquire global barrier 2023-07-24 12:28:09,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:09,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:09,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:09,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:09,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:09,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:09,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:09,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:09,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:09,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,36595,1690201659396' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-24 12:28:09,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@215afab2[Count = 0] remaining members to acquire global barrier 2023-07-24 12:28:09,296 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 12:28:09,297 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,346 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,346 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,346 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,346 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:09,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,346 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 12:28:09,347 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 12:28:09,346 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 12:28:09,347 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 12:28:09,347 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase6.apache.org,44517,1690201659253' in zk 2023-07-24 12:28:09,347 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:09,347 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 12:28:09,347 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 12:28:09,347 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 12:28:09,347 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79. 2023-07-24 12:28:09,347 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 12:28:09,347 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79. started... 2023-07-24 12:28:09,347 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 12:28:09,347 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f. 2023-07-24 12:28:09,347 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f. started... 2023-07-24 12:28:09,347 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a752ae27b310a6ef5c5909d0b0256d79: 2023-07-24 12:28:09,349 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 50d12b51b8388ce3f4d92a330f280c2f: 2023-07-24 12:28:09,349 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,349 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 12:28:09,349 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,349 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 12:28:09,349 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 12:28:09,349 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 12:28:09,365 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79. completed. 2023-07-24 12:28:09,365 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79. 2023-07-24 12:28:09,366 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f. completed. 2023-07-24 12:28:09,366 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 12:28:09,366 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 12:28:09,366 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:09,366 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f. 2023-07-24 12:28:09,366 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 12:28:09,366 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 12:28:09,366 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 12:28:09,366 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:09,366 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase6.apache.org,36595,1690201659396' in zk 2023-07-24 12:28:09,366 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 12:28:09,366 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase6.apache.org,44275,1690201659331' in zk 2023-07-24 12:28:09,374 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:28:09,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 12:28:09,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:28:09,375 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 12:28:09,392 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 12:28:09,392 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:28:09,392 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 12:28:09,416 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 12:28:09,416 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:09,416 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:28:09,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:09,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:09,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:09,416 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 12:28:09,461 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:09,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:09,461 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 12:28:09,461 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:28:09,461 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 12:28:09,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:09,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:09,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:09,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:09,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:09,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:09,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:09,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:09,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase6.apache.org,44275,1690201659331': 2023-07-24 12:28:09,466 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,44275,1690201659331' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 12:28:09,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:09,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:09,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:09,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:09,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:09,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:09,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:09,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:09,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:09,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:09,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:09,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:09,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase6.apache.org,36595,1690201659396': 2023-07-24 12:28:09,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,36595,1690201659396' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 12:28:09,470 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-24 12:28:09,470 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 12:28:09,470 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 12:28:09,470 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,470 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 12:28:09,507 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,507 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:09,507 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:09,507 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,507 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,508 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:09,508 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:09,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,508 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:09,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:09,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:09,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:09,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:09,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:09,509 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:09,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:09,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:09,509 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:09,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:09,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:09,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:09,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:09,511 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:09,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,512 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:09,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:09,512 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:09,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:09,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:09,530 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:09,530 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:09,530 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:09,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:09,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:09,531 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:09,531 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:09,531 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,531 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:28:09,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:09,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:09,530 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,530 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:09,532 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:09,532 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:09,532 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:09,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:09,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:09,531 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-24 12:28:09,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:09,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:09,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:09,532 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:09,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:09,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 12:28:09,533 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:09,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:09,533 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,533 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:09,533 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:09,533 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,533 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,534 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 12:28:09,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,548 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,592 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-24 12:28:09,592 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,592 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:09,592 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690201689072Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1690201689547 (+475 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1690201689547Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1690201689547Writing data manifest for emptySnaptb0-testExportFileSystemState at 1690201689556 (+9 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1690201689565 (+9 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690201689592 (+27 ms) 2023-07-24 12:28:09,595 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 12:28:09,597 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 522 msec 2023-07-24 12:28:09,676 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:28:09,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 12:28:09,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 12:28:09,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36595] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 12:28:09,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44275] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 12:28:09,686 DEBUG [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-24 12:28:09,686 DEBUG [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79. 2023-07-24 12:28:09,686 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 12:28:09,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1583): Client=jenkins//172.31.2.20 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 12:28:09,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690201689698 (current time:1690201689698). 2023-07-24 12:28:09,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 12:28:09,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(139): Connect 0x095c4fab to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:28:09,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e150603, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:28:09,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:28:09,773 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:59222, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:28:09,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x095c4fab to 127.0.0.1:49553 2023-07-24 12:28:09,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:28:09,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(139): Connect 0x5faa4f6d to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:28:09,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22d34fa5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:28:09,871 DEBUG [hconnection-0x6bf3e283-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:28:09,873 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:59224, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:28:09,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:28:09,879 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:53614, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:28:09,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5faa4f6d to 127.0.0.1:49553 2023-07-24 12:28:09,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:28:09,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 12:28:09,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 12:28:09,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 12:28:09,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 12:28:09,885 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 12:28:09,886 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690202289886 2023-07-24 12:28:09,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 12:28:09,886 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-24 12:28:09,888 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 12:28:09,888 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 12:28:09,888 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 12:28:09,889 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 12:28:09,891 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-24 12:28:09,892 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 12:28:09,893 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690202289893 2023-07-24 12:28:09,919 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-24 12:28:09,919 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-24 12:28:09,919 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:28:09,920 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-24 12:28:09,920 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-24 12:28:09,921 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 12:28:09,921 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 12:28:09,954 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:09,954 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:09,954 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:09,954 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:09,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:09,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:09,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:09,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:09,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:09,954 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:09,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:09,954 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:09,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 12:28:09,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 12:28:09,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 12:28:09,955 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:09,955 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 12:28:09,955 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 12:28:09,955 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 12:28:09,955 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 12:28:09,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 12:28:09,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 12:28:09,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 12:28:09,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 12:28:09,955 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 12:28:09,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 12:28:09,955 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 12:28:09,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 12:28:09,956 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 12:28:09,956 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 12:28:09,956 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 12:28:09,956 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 12:28:09,956 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:28:09,956 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 12:28:09,956 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:28:09,960 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 12:28:09,960 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 12:28:09,961 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 12:28:09,961 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44517,1690201659253' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 12:28:09,960 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 12:28:09,961 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 12:28:09,961 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 12:28:09,961 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44275,1690201659331' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 12:28:09,961 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:28:09,962 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 12:28:09,962 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 12:28:09,962 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,36595,1690201659396' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 12:28:09,988 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:28:09,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 12:28:09,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:28:09,989 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 12:28:10,000 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,030 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:10,030 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:10,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:10,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:10,030 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:10,030 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,031 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:28:10,030 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,031 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:10,031 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:28:10,031 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,031 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:28:10,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:10,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 12:28:10,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:10,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:10,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:10,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:10,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,44275,1690201659331' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-24 12:28:10,033 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44699361[Count = 1] remaining members to acquire global barrier 2023-07-24 12:28:10,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:10,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:10,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:10,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:10,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:10,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 12:28:10,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:10,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:10,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:10,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:10,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,36595,1690201659396' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-24 12:28:10,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44699361[Count = 0] remaining members to acquire global barrier 2023-07-24 12:28:10,035 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 12:28:10,035 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,084 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,084 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,084 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,085 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:10,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,085 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 12:28:10,085 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 12:28:10,085 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 12:28:10,085 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase6.apache.org,44517,1690201659253' in zk 2023-07-24 12:28:10,085 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 12:28:10,085 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:10,085 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 12:28:10,085 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 12:28:10,085 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 12:28:10,085 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 12:28:10,085 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 12:28:10,085 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79. 2023-07-24 12:28:10,085 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f. 2023-07-24 12:28:10,085 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79. started... 2023-07-24 12:28:10,085 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f. started... 2023-07-24 12:28:10,086 INFO [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a752ae27b310a6ef5c5909d0b0256d79 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-24 12:28:10,086 INFO [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 50d12b51b8388ce3f4d92a330f280c2f 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-24 12:28:10,093 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 12:28:10,093 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:28:10,093 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 12:28:10,107 INFO [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307243beae814ae8948be8604727f7d4df37d to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307243beae814ae8948be8604727f7d4df37d 2023-07-24 12:28:10,116 INFO [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemState/a752ae27b310a6ef5c5909d0b0256d79/.tmp/cf/9eb76133b66b448788a8f0da9b458210 2023-07-24 12:28:10,122 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemState/a752ae27b310a6ef5c5909d0b0256d79/.tmp/cf/9eb76133b66b448788a8f0da9b458210 as hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemState/a752ae27b310a6ef5c5909d0b0256d79/cf/9eb76133b66b448788a8f0da9b458210 2023-07-24 12:28:10,127 INFO [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemState/a752ae27b310a6ef5c5909d0b0256d79/cf/9eb76133b66b448788a8f0da9b458210, entries=3, sequenceid=6, filesize=5.4 K 2023-07-24 12:28:10,128 INFO [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for a752ae27b310a6ef5c5909d0b0256d79 in 42ms, sequenceid=6, compaction requested=false 2023-07-24 12:28:10,128 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-24 12:28:10,129 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a752ae27b310a6ef5c5909d0b0256d79: 2023-07-24 12:28:10,129 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 12:28:10,129 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 12:28:10,129 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemState/a752ae27b310a6ef5c5909d0b0256d79/cf/9eb76133b66b448788a8f0da9b458210] hfiles 2023-07-24 12:28:10,129 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemState/a752ae27b310a6ef5c5909d0b0256d79/cf/9eb76133b66b448788a8f0da9b458210 for snapshot=snaptb0-testExportFileSystemState 2023-07-24 12:28:10,136 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79. completed. 2023-07-24 12:28:10,136 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79. 2023-07-24 12:28:10,136 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 12:28:10,136 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 12:28:10,136 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:10,136 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 12:28:10,136 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase6.apache.org,36595,1690201659396' in zk 2023-07-24 12:28:10,142 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 12:28:10,142 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:10,142 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:28:10,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:10,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:10,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:10,142 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 12:28:10,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:10,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:10,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 12:28:10,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:10,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:10,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:10,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:10,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 12:28:10,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:10,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:10,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase6.apache.org,36595,1690201659396': 2023-07-24 12:28:10,147 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,36595,1690201659396' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 12:28:10,189 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:28:10,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 12:28:10,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:28:10,191 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 12:28:10,491 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:28:10,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 12:28:10,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:28:10,492 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 12:28:10,511 INFO [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230724dd6bd7f842764430a1e1a6fb6a5cccc7 to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230724dd6bd7f842764430a1e1a6fb6a5cccc7 2023-07-24 12:28:10,519 INFO [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemState/50d12b51b8388ce3f4d92a330f280c2f/.tmp/cf/56da32690a254a3b9d118b532b4781f5 2023-07-24 12:28:10,525 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemState/50d12b51b8388ce3f4d92a330f280c2f/.tmp/cf/56da32690a254a3b9d118b532b4781f5 as hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemState/50d12b51b8388ce3f4d92a330f280c2f/cf/56da32690a254a3b9d118b532b4781f5 2023-07-24 12:28:10,530 INFO [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemState/50d12b51b8388ce3f4d92a330f280c2f/cf/56da32690a254a3b9d118b532b4781f5, entries=47, sequenceid=6, filesize=12.8 K 2023-07-24 12:28:10,531 INFO [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 50d12b51b8388ce3f4d92a330f280c2f in 445ms, sequenceid=6, compaction requested=false 2023-07-24 12:28:10,532 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 50d12b51b8388ce3f4d92a330f280c2f: 2023-07-24 12:28:10,533 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 12:28:10,533 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 12:28:10,533 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemState/50d12b51b8388ce3f4d92a330f280c2f/cf/56da32690a254a3b9d118b532b4781f5] hfiles 2023-07-24 12:28:10,533 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemState/50d12b51b8388ce3f4d92a330f280c2f/cf/56da32690a254a3b9d118b532b4781f5 for snapshot=snaptb0-testExportFileSystemState 2023-07-24 12:28:10,540 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f. completed. 2023-07-24 12:28:10,540 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f. 2023-07-24 12:28:10,540 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 12:28:10,540 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 12:28:10,541 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:10,541 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 12:28:10,541 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase6.apache.org,44275,1690201659331' in zk 2023-07-24 12:28:10,542 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 12:28:10,542 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:10,542 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:28:10,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:10,542 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 12:28:10,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:10,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:10,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:10,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:10,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 12:28:10,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:10,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:10,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:10,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:10,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 12:28:10,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:10,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:10,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:10,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase6.apache.org,44275,1690201659331': 2023-07-24 12:28:10,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,44275,1690201659331' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 12:28:10,548 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-24 12:28:10,548 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 12:28:10,548 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 12:28:10,548 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-24 12:28:10,548 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 12:28:10,551 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,551 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,551 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:10,551 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:10,551 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,551 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:10,552 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:10,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:10,551 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:10,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:10,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:10,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:10,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:10,552 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:10,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:10,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:10,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:10,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,552 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:10,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 12:28:10,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:10,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 12:28:10,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:10,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:10,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:10,554 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:10,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:10,554 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:10,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 12:28:10,555 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:10,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:10,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:10,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:10,558 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:10,558 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:10,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:10,558 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:10,558 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:10,558 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,558 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:10,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:10,558 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:10,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:10,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:10,558 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:10,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:10,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:10,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:10,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:10,558 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:10,559 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:10,559 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:10,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:10,558 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-24 12:28:10,559 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-24 12:28:10,559 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 12:28:10,559 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 12:28:10,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:10,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:10,558 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:28:10,559 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:10,561 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,561 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:10,561 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:10,561 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,561 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,561 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230724dd6bd7f842764430a1e1a6fb6a5cccc7, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307243beae814ae8948be8604727f7d4df37d] mob files 2023-07-24 12:28:10,561 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230724dd6bd7f842764430a1e1a6fb6a5cccc7 2023-07-24 12:28:10,561 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307243beae814ae8948be8604727f7d4df37d 2023-07-24 12:28:10,569 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-24 12:28:10,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,590 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,610 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-24 12:28:10,610 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,610 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 12:28:10,610 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690201689886Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1690201690569 (+683 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1690201690569Loading Region manifests for snaptb0-testExportFileSystemState at 1690201690569Writing data manifest for snaptb0-testExportFileSystemState at 1690201690573 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1690201690582 (+9 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690201690610 (+28 ms) 2023-07-24 12:28:10,613 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 12:28:10,615 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 726 msec 2023-07-24 12:28:10,992 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:28:10,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 12:28:10,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 12:28:10,994 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201690994 2023-07-24 12:28:10,994 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42387, tgtDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201690994, rawTgtDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201690994, srcFsUri=hdfs://localhost:42387, srcDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa 2023-07-24 12:28:11,024 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42387, inputRoot=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa 2023-07-24 12:28:11,024 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_120350773_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201690994, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201690994/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 12:28:11,025 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42387, inputRoot=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa, snapshotDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-24 12:28:11,044 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201690994/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 12:28:11,074 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:11,074 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:11,074 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:11,075 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:11,075 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:11,075 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:11,076 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:11,153 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/hadoop-460789787937557241.jar 2023-07-24 12:28:11,154 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:11,154 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:11,154 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:11,155 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:11,155 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:11,156 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:11,156 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 12:28:11,156 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 12:28:11,157 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 12:28:11,157 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 12:28:11,158 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 12:28:11,158 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 12:28:11,158 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 12:28:11,159 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 12:28:11,159 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 12:28:11,160 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 12:28:11,160 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:28:11,160 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:28:11,161 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 12:28:11,161 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:28:11,161 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:28:11,162 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 12:28:11,162 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 12:28:11,693 WARN [Listener at jenkins-hbase6.apache.org/41373] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 12:28:11,696 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-24 12:28:11,699 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-24 12:28:12,161 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 12:28:12,161 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 12:28:12,166 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0001_000001 (auth:SIMPLE) 2023-07-24 12:28:12,956 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0002_000001 (auth:SIMPLE) 2023-07-24 12:28:13,617 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 12:28:17,434 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0002_000001 (auth:SIMPLE) 2023-07-24 12:28:19,676 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0002_000001 (auth:SIMPLE) 2023-07-24 12:28:22,463 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0002_000001 (auth:SIMPLE) 2023-07-24 12:28:23,936 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 12:28:23,937 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 12:28:23,946 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-24 12:28:23,947 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 12:28:23,947 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 12:28:23,947 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1338397176_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 12:28:23,948 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-24 12:28:23,948 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-24 12:28:23,948 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1338397176_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201690994/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201690994/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 12:28:23,949 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201690994/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-24 12:28:23,949 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201690994/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-24 12:28:23,964 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-24 12:28:23,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.HMaster$11(2418): Client=jenkins//172.31.2.20 disable testtb-testExportFileSystemState 2023-07-24 12:28:23,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-24 12:28:23,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 12:28:23,972 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201703972"}]},"ts":"1690201703972"} 2023-07-24 12:28:23,974 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-24 12:28:23,976 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-24 12:28:23,977 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a752ae27b310a6ef5c5909d0b0256d79, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=50d12b51b8388ce3f4d92a330f280c2f, UNASSIGN}] 2023-07-24 12:28:23,979 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a752ae27b310a6ef5c5909d0b0256d79, UNASSIGN 2023-07-24 12:28:23,979 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=50d12b51b8388ce3f4d92a330f280c2f, UNASSIGN 2023-07-24 12:28:23,980 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=a752ae27b310a6ef5c5909d0b0256d79, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:23,980 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=50d12b51b8388ce3f4d92a330f280c2f, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:23,980 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690201703980"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201703980"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201703980"}]},"ts":"1690201703980"} 2023-07-24 12:28:23,980 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690201703980"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201703980"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201703980"}]},"ts":"1690201703980"} 2023-07-24 12:28:23,982 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 50d12b51b8388ce3f4d92a330f280c2f, server=jenkins-hbase6.apache.org,44275,1690201659331}] 2023-07-24 12:28:23,983 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure a752ae27b310a6ef5c5909d0b0256d79, server=jenkins-hbase6.apache.org,36595,1690201659396}] 2023-07-24 12:28:24,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 12:28:24,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(111): Close 50d12b51b8388ce3f4d92a330f280c2f 2023-07-24 12:28:24,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 50d12b51b8388ce3f4d92a330f280c2f, disabling compactions & flushes 2023-07-24 12:28:24,135 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f. 2023-07-24 12:28:24,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f. 2023-07-24 12:28:24,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f. after waiting 0 ms 2023-07-24 12:28:24,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f. 2023-07-24 12:28:24,136 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(111): Close a752ae27b310a6ef5c5909d0b0256d79 2023-07-24 12:28:24,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing a752ae27b310a6ef5c5909d0b0256d79, disabling compactions & flushes 2023-07-24 12:28:24,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79. 2023-07-24 12:28:24,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79. 2023-07-24 12:28:24,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79. after waiting 0 ms 2023-07-24 12:28:24,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79. 2023-07-24 12:28:24,155 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemState/50d12b51b8388ce3f4d92a330f280c2f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 12:28:24,156 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 12:28:24,157 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f. 2023-07-24 12:28:24,157 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 50d12b51b8388ce3f4d92a330f280c2f: 2023-07-24 12:28:24,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemState/a752ae27b310a6ef5c5909d0b0256d79/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 12:28:24,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 12:28:24,160 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79. 2023-07-24 12:28:24,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for a752ae27b310a6ef5c5909d0b0256d79: 2023-07-24 12:28:24,160 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(149): Closed 50d12b51b8388ce3f4d92a330f280c2f 2023-07-24 12:28:24,161 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=50d12b51b8388ce3f4d92a330f280c2f, regionState=CLOSED 2023-07-24 12:28:24,162 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690201704161"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201704161"}]},"ts":"1690201704161"} 2023-07-24 12:28:24,162 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(149): Closed a752ae27b310a6ef5c5909d0b0256d79 2023-07-24 12:28:24,163 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=a752ae27b310a6ef5c5909d0b0256d79, regionState=CLOSED 2023-07-24 12:28:24,163 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690201704163"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201704163"}]},"ts":"1690201704163"} 2023-07-24 12:28:24,174 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-24 12:28:24,174 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 50d12b51b8388ce3f4d92a330f280c2f, server=jenkins-hbase6.apache.org,44275,1690201659331 in 188 msec 2023-07-24 12:28:24,177 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-24 12:28:24,177 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=50d12b51b8388ce3f4d92a330f280c2f, UNASSIGN in 197 msec 2023-07-24 12:28:24,177 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure a752ae27b310a6ef5c5909d0b0256d79, server=jenkins-hbase6.apache.org,36595,1690201659396 in 189 msec 2023-07-24 12:28:24,180 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-24 12:28:24,181 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=a752ae27b310a6ef5c5909d0b0256d79, UNASSIGN in 200 msec 2023-07-24 12:28:24,182 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201704181"}]},"ts":"1690201704181"} 2023-07-24 12:28:24,183 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-24 12:28:24,185 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-24 12:28:24,187 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 221 msec 2023-07-24 12:28:24,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 12:28:24,274 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-24 12:28:24,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.HMaster$5(2228): Client=jenkins//172.31.2.20 delete testtb-testExportFileSystemState 2023-07-24 12:28:24,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 12:28:24,278 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 12:28:24,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-24 12:28:24,279 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 12:28:24,280 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36595] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-24 12:28:24,284 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemState/a752ae27b310a6ef5c5909d0b0256d79 2023-07-24 12:28:24,284 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemState/50d12b51b8388ce3f4d92a330f280c2f 2023-07-24 12:28:24,284 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 12:28:24,284 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 12:28:24,284 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 12:28:24,284 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 12:28:24,285 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 12:28:24,285 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 12:28:24,285 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 12:28:24,285 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 12:28:24,286 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 12:28:24,286 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 12:28:24,286 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 12:28:24,286 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:28:24,286 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 12:28:24,286 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:28:24,286 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:28:24,286 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:28:24,287 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemState/50d12b51b8388ce3f4d92a330f280c2f/cf, FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemState/50d12b51b8388ce3f4d92a330f280c2f/recovered.edits] 2023-07-24 12:28:24,287 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemState/a752ae27b310a6ef5c5909d0b0256d79/cf, FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemState/a752ae27b310a6ef5c5909d0b0256d79/recovered.edits] 2023-07-24 12:28:24,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-24 12:28:24,291 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemState/50d12b51b8388ce3f4d92a330f280c2f/cf/56da32690a254a3b9d118b532b4781f5 to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportFileSystemState/50d12b51b8388ce3f4d92a330f280c2f/cf/56da32690a254a3b9d118b532b4781f5 2023-07-24 12:28:24,292 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemState/a752ae27b310a6ef5c5909d0b0256d79/cf/9eb76133b66b448788a8f0da9b458210 to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportFileSystemState/a752ae27b310a6ef5c5909d0b0256d79/cf/9eb76133b66b448788a8f0da9b458210 2023-07-24 12:28:24,295 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemState/50d12b51b8388ce3f4d92a330f280c2f/recovered.edits/9.seqid to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportFileSystemState/50d12b51b8388ce3f4d92a330f280c2f/recovered.edits/9.seqid 2023-07-24 12:28:24,295 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemState/a752ae27b310a6ef5c5909d0b0256d79/recovered.edits/9.seqid to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportFileSystemState/a752ae27b310a6ef5c5909d0b0256d79/recovered.edits/9.seqid 2023-07-24 12:28:24,295 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemState/50d12b51b8388ce3f4d92a330f280c2f 2023-07-24 12:28:24,295 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemState/a752ae27b310a6ef5c5909d0b0256d79 2023-07-24 12:28:24,296 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-24 12:28:24,296 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-24 12:28:24,297 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-24 12:28:24,301 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230724dd6bd7f842764430a1e1a6fb6a5cccc7 to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230724dd6bd7f842764430a1e1a6fb6a5cccc7 2023-07-24 12:28:24,302 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307243beae814ae8948be8604727f7d4df37d to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202307243beae814ae8948be8604727f7d4df37d 2023-07-24 12:28:24,302 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-24 12:28:24,305 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 12:28:24,307 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-24 12:28:24,309 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-24 12:28:24,310 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 12:28:24,310 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-24 12:28:24,310 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690201704310"}]},"ts":"9223372036854775807"} 2023-07-24 12:28:24,310 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690201704310"}]},"ts":"9223372036854775807"} 2023-07-24 12:28:24,312 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 12:28:24,312 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a752ae27b310a6ef5c5909d0b0256d79, NAME => 'testtb-testExportFileSystemState,,1690201688279.a752ae27b310a6ef5c5909d0b0256d79.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 50d12b51b8388ce3f4d92a330f280c2f, NAME => 'testtb-testExportFileSystemState,1,1690201688279.50d12b51b8388ce3f4d92a330f280c2f.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 12:28:24,312 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-24 12:28:24,312 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690201704312"}]},"ts":"9223372036854775807"} 2023-07-24 12:28:24,314 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-24 12:28:24,316 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 12:28:24,317 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 41 msec 2023-07-24 12:28:24,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-24 12:28:24,388 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-24 12:28:24,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(751): Client=jenkins//172.31.2.20 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-24 12:28:24,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-24 12:28:24,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(751): Client=jenkins//172.31.2.20 delete name: "snaptb0-testExportFileSystemState" 2023-07-24 12:28:24,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-24 12:28:24,428 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=765 (was 754) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase6.apache.org/172.31.2.20:44193 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1919781302_1 at /127.0.0.1:35376 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4f8b35dd-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1338397176_17 at /127.0.0.1:49664 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1338397176_17 at /127.0.0.1:35412 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2146 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x4f8b35dd-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4f8b35dd-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4f8b35dd-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1919781302_1 at /127.0.0.1:37260 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1338397176_17 at /127.0.0.1:37280 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=929 (was 938), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=347 (was 283) - SystemLoadAverage LEAK? -, ProcessCount=177 (was 176) - ProcessCount LEAK? -, AvailableMemoryMB=955 (was 829) - AvailableMemoryMB LEAK? - 2023-07-24 12:28:24,428 WARN [Listener at jenkins-hbase6.apache.org/41373] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-24 12:28:24,447 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=929, MaxFileDescriptor=60000, SystemLoadAverage=347, ProcessCount=177, AvailableMemoryMB=954 2023-07-24 12:28:24,447 WARN [Listener at jenkins-hbase6.apache.org/41373] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-24 12:28:24,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.HMaster$4(2112): Client=jenkins//172.31.2.20 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 12:28:24,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-24 12:28:24,452 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 12:28:24,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(700): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-24 12:28:24,453 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 12:28:24,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 12:28:24,455 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testConsecutiveExports/2b76177242f5cd392041577927d0faa5 2023-07-24 12:28:24,455 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testConsecutiveExports/a0cad1ce4789583e3d7314804dd9c0ba 2023-07-24 12:28:24,456 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testConsecutiveExports/2b76177242f5cd392041577927d0faa5 empty. 2023-07-24 12:28:24,456 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testConsecutiveExports/a0cad1ce4789583e3d7314804dd9c0ba empty. 2023-07-24 12:28:24,456 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testConsecutiveExports/2b76177242f5cd392041577927d0faa5 2023-07-24 12:28:24,456 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testConsecutiveExports/a0cad1ce4789583e3d7314804dd9c0ba 2023-07-24 12:28:24,456 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-24 12:28:24,473 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-24 12:28:24,474 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2b76177242f5cd392041577927d0faa5, NAME => 'testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp 2023-07-24 12:28:24,475 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => a0cad1ce4789583e3d7314804dd9c0ba, NAME => 'testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp 2023-07-24 12:28:24,490 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:28:24,490 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:28:24,490 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 2b76177242f5cd392041577927d0faa5, disabling compactions & flushes 2023-07-24 12:28:24,490 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing a0cad1ce4789583e3d7314804dd9c0ba, disabling compactions & flushes 2023-07-24 12:28:24,490 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5. 2023-07-24 12:28:24,490 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba. 2023-07-24 12:28:24,490 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba. 2023-07-24 12:28:24,490 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5. 2023-07-24 12:28:24,490 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba. after waiting 0 ms 2023-07-24 12:28:24,490 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba. 2023-07-24 12:28:24,490 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5. after waiting 0 ms 2023-07-24 12:28:24,490 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba. 2023-07-24 12:28:24,490 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5. 2023-07-24 12:28:24,490 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for a0cad1ce4789583e3d7314804dd9c0ba: 2023-07-24 12:28:24,490 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5. 2023-07-24 12:28:24,490 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 2b76177242f5cd392041577927d0faa5: 2023-07-24 12:28:24,492 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 12:28:24,493 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690201704493"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201704493"}]},"ts":"1690201704493"} 2023-07-24 12:28:24,493 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690201704493"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201704493"}]},"ts":"1690201704493"} 2023-07-24 12:28:24,496 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 12:28:24,497 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 12:28:24,497 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201704497"}]},"ts":"1690201704497"} 2023-07-24 12:28:24,498 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-24 12:28:24,502 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-07-24 12:28:24,503 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 12:28:24,503 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 12:28:24,503 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 12:28:24,503 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 12:28:24,504 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2b76177242f5cd392041577927d0faa5, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a0cad1ce4789583e3d7314804dd9c0ba, ASSIGN}] 2023-07-24 12:28:24,506 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a0cad1ce4789583e3d7314804dd9c0ba, ASSIGN 2023-07-24 12:28:24,506 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2b76177242f5cd392041577927d0faa5, ASSIGN 2023-07-24 12:28:24,507 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a0cad1ce4789583e3d7314804dd9c0ba, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,44517,1690201659253; forceNewPlan=false, retain=false 2023-07-24 12:28:24,507 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2b76177242f5cd392041577927d0faa5, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,36595,1690201659396; forceNewPlan=false, retain=false 2023-07-24 12:28:24,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 12:28:24,657 INFO [jenkins-hbase6:38215] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 12:28:24,660 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=2b76177242f5cd392041577927d0faa5, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:24,660 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=a0cad1ce4789583e3d7314804dd9c0ba, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:24,660 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690201704659"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201704659"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201704659"}]},"ts":"1690201704659"} 2023-07-24 12:28:24,660 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690201704659"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201704659"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201704659"}]},"ts":"1690201704659"} 2023-07-24 12:28:24,662 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 2b76177242f5cd392041577927d0faa5, server=jenkins-hbase6.apache.org,36595,1690201659396}] 2023-07-24 12:28:24,662 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure a0cad1ce4789583e3d7314804dd9c0ba, server=jenkins-hbase6.apache.org,44517,1690201659253}] 2023-07-24 12:28:24,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 12:28:24,819 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5. 2023-07-24 12:28:24,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2b76177242f5cd392041577927d0faa5, NAME => 'testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 12:28:24,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5. service=AccessControlService 2023-07-24 12:28:24,820 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 12:28:24,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 2b76177242f5cd392041577927d0faa5 2023-07-24 12:28:24,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:28:24,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 2b76177242f5cd392041577927d0faa5 2023-07-24 12:28:24,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 2b76177242f5cd392041577927d0faa5 2023-07-24 12:28:24,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba. 2023-07-24 12:28:24,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a0cad1ce4789583e3d7314804dd9c0ba, NAME => 'testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 12:28:24,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba. service=AccessControlService 2023-07-24 12:28:24,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 12:28:24,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports a0cad1ce4789583e3d7314804dd9c0ba 2023-07-24 12:28:24,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:28:24,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for a0cad1ce4789583e3d7314804dd9c0ba 2023-07-24 12:28:24,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for a0cad1ce4789583e3d7314804dd9c0ba 2023-07-24 12:28:24,822 INFO [StoreOpener-2b76177242f5cd392041577927d0faa5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2b76177242f5cd392041577927d0faa5 2023-07-24 12:28:24,823 INFO [StoreOpener-a0cad1ce4789583e3d7314804dd9c0ba-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a0cad1ce4789583e3d7314804dd9c0ba 2023-07-24 12:28:24,823 DEBUG [StoreOpener-2b76177242f5cd392041577927d0faa5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testConsecutiveExports/2b76177242f5cd392041577927d0faa5/cf 2023-07-24 12:28:24,823 DEBUG [StoreOpener-2b76177242f5cd392041577927d0faa5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testConsecutiveExports/2b76177242f5cd392041577927d0faa5/cf 2023-07-24 12:28:24,824 INFO [StoreOpener-2b76177242f5cd392041577927d0faa5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b76177242f5cd392041577927d0faa5 columnFamilyName cf 2023-07-24 12:28:24,824 DEBUG [StoreOpener-a0cad1ce4789583e3d7314804dd9c0ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testConsecutiveExports/a0cad1ce4789583e3d7314804dd9c0ba/cf 2023-07-24 12:28:24,824 DEBUG [StoreOpener-a0cad1ce4789583e3d7314804dd9c0ba-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testConsecutiveExports/a0cad1ce4789583e3d7314804dd9c0ba/cf 2023-07-24 12:28:24,825 INFO [StoreOpener-a0cad1ce4789583e3d7314804dd9c0ba-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a0cad1ce4789583e3d7314804dd9c0ba columnFamilyName cf 2023-07-24 12:28:24,825 INFO [StoreOpener-2b76177242f5cd392041577927d0faa5-1] regionserver.HStore(310): Store=2b76177242f5cd392041577927d0faa5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 12:28:24,826 INFO [StoreOpener-a0cad1ce4789583e3d7314804dd9c0ba-1] regionserver.HStore(310): Store=a0cad1ce4789583e3d7314804dd9c0ba/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 12:28:24,826 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testConsecutiveExports/2b76177242f5cd392041577927d0faa5 2023-07-24 12:28:24,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testConsecutiveExports/2b76177242f5cd392041577927d0faa5 2023-07-24 12:28:24,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testConsecutiveExports/a0cad1ce4789583e3d7314804dd9c0ba 2023-07-24 12:28:24,827 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testConsecutiveExports/a0cad1ce4789583e3d7314804dd9c0ba 2023-07-24 12:28:24,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 2b76177242f5cd392041577927d0faa5 2023-07-24 12:28:24,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for a0cad1ce4789583e3d7314804dd9c0ba 2023-07-24 12:28:24,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testConsecutiveExports/2b76177242f5cd392041577927d0faa5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 12:28:24,832 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 2b76177242f5cd392041577927d0faa5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72962173, jitterRate=0.08722110092639923}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 12:28:24,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 2b76177242f5cd392041577927d0faa5: 2023-07-24 12:28:24,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testConsecutiveExports/a0cad1ce4789583e3d7314804dd9c0ba/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 12:28:24,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5., pid=45, masterSystemTime=1690201704813 2023-07-24 12:28:24,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened a0cad1ce4789583e3d7314804dd9c0ba; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60040848, jitterRate=-0.10532164573669434}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 12:28:24,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for a0cad1ce4789583e3d7314804dd9c0ba: 2023-07-24 12:28:24,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba., pid=46, masterSystemTime=1690201704814 2023-07-24 12:28:24,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5. 2023-07-24 12:28:24,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5. 2023-07-24 12:28:24,835 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=2b76177242f5cd392041577927d0faa5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:24,835 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690201704835"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690201704835"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690201704835"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690201704835"}]},"ts":"1690201704835"} 2023-07-24 12:28:24,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba. 2023-07-24 12:28:24,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba. 2023-07-24 12:28:24,837 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=a0cad1ce4789583e3d7314804dd9c0ba, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:24,837 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690201704837"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690201704837"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690201704837"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690201704837"}]},"ts":"1690201704837"} 2023-07-24 12:28:24,840 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-24 12:28:24,840 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 2b76177242f5cd392041577927d0faa5, server=jenkins-hbase6.apache.org,36595,1690201659396 in 176 msec 2023-07-24 12:28:24,841 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-24 12:28:24,841 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2b76177242f5cd392041577927d0faa5, ASSIGN in 336 msec 2023-07-24 12:28:24,841 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure a0cad1ce4789583e3d7314804dd9c0ba, server=jenkins-hbase6.apache.org,44517,1690201659253 in 177 msec 2023-07-24 12:28:24,844 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-24 12:28:24,844 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a0cad1ce4789583e3d7314804dd9c0ba, ASSIGN in 337 msec 2023-07-24 12:28:24,846 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 12:28:24,847 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201704847"}]},"ts":"1690201704847"} 2023-07-24 12:28:24,848 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-24 12:28:24,850 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 12:28:24,851 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-24 12:28:24,853 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36595] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 12:28:24,854 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:28:24,854 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:28:24,854 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:28:24,854 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:28:24,856 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 12:28:24,857 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 12:28:24,857 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 12:28:24,857 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 12:28:24,859 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 408 msec 2023-07-24 12:28:25,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 12:28:25,057 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-24 12:28:25,059 DEBUG [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-24 12:28:25,059 DEBUG [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5. 2023-07-24 12:28:25,061 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 12:28:25,072 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1583): Client=jenkins//172.31.2.20 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 12:28:25,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690201705072 (current time:1690201705072). 2023-07-24 12:28:25,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 12:28:25,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(139): Connect 0x27a02746 to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:28:25,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5abf7c69, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:28:25,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:28:25,083 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:49014, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:28:25,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27a02746 to 127.0.0.1:49553 2023-07-24 12:28:25,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:28:25,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(139): Connect 0x0bc794b2 to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:28:25,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d7b189b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:28:25,091 DEBUG [hconnection-0xc867569-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:28:25,093 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:49018, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:28:25,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:28:25,099 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:56224, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:28:25,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bc794b2 to 127.0.0.1:49553 2023-07-24 12:28:25,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:28:25,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 12:28:25,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 12:28:25,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 12:28:25,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 12:28:25,105 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 12:28:25,106 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690202305106 2023-07-24 12:28:25,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 12:28:25,106 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-24 12:28:25,107 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 12:28:25,107 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 12:28:25,112 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 12:28:25,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 12:28:25,113 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 9 msec 2023-07-24 12:28:25,114 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 12:28:25,115 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690202305115 2023-07-24 12:28:25,129 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,129 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-24 12:28:25,129 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:28:25,130 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-24 12:28:25,130 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-24 12:28:25,204 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,204 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,205 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:25,205 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:25,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:25,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:25,205 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:25,205 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:25,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:25,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:25,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:25,206 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,206 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,206 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,206 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,207 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,207 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,206 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 12:28:25,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 12:28:25,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 12:28:25,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 12:28:25,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,207 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 12:28:25,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,207 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 12:28:25,207 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 12:28:25,207 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,207 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 12:28:25,207 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,207 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,208 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:28:25,207 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:28:25,208 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 12:28:25,209 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 12:28:25,209 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:28:25,208 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 12:28:25,210 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 12:28:25,210 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 12:28:25,210 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:28:25,209 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 12:28:25,213 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44517,1690201659253' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 12:28:25,213 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 12:28:25,210 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44275,1690201659331' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 12:28:25,213 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 12:28:25,213 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,36595,1690201659396' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 12:28:25,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 12:28:25,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:28:25,214 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 12:28:25,214 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,214 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:25,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:25,215 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,215 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,215 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,215 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:28:25,215 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:25,216 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,216 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:28:25,216 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,216 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:28:25,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:25,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:25,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:25,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,44517,1690201659253' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-24 12:28:25,217 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43a45cd0[Count = 1] remaining members to acquire global barrier 2023-07-24 12:28:25,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:25,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:25,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:25,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:25,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:25,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:25,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,36595,1690201659396' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-24 12:28:25,219 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43a45cd0[Count = 0] remaining members to acquire global barrier 2023-07-24 12:28:25,219 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-24 12:28:25,219 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,221 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,221 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,221 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,222 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 12:28:25,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,222 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,222 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 12:28:25,222 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 12:28:25,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,222 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba. 2023-07-24 12:28:25,222 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 12:28:25,222 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba. started... 2023-07-24 12:28:25,222 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,222 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 12:28:25,222 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 12:28:25,222 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 12:28:25,222 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase6.apache.org,44275,1690201659331' in zk 2023-07-24 12:28:25,223 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a0cad1ce4789583e3d7314804dd9c0ba: 2023-07-24 12:28:25,222 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 12:28:25,223 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 12:28:25,223 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5. 2023-07-24 12:28:25,223 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5. started... 2023-07-24 12:28:25,223 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,223 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 12:28:25,223 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 12:28:25,223 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2b76177242f5cd392041577927d0faa5: 2023-07-24 12:28:25,224 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,224 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 12:28:25,224 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 12:28:25,232 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 12:28:25,232 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:28:25,232 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 12:28:25,238 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba. completed. 2023-07-24 12:28:25,238 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba. 2023-07-24 12:28:25,238 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 12:28:25,239 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 12:28:25,239 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,239 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5. completed. 2023-07-24 12:28:25,239 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 12:28:25,239 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5. 2023-07-24 12:28:25,239 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase6.apache.org,44517,1690201659253' in zk 2023-07-24 12:28:25,239 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 12:28:25,239 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 12:28:25,239 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,239 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 12:28:25,239 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase6.apache.org,36595,1690201659396' in zk 2023-07-24 12:28:25,240 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 12:28:25,240 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,240 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:28:25,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:25,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:25,242 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 12:28:25,240 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 12:28:25,242 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:28:25,242 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,242 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 12:28:25,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:25,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:25,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:25,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:25,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:25,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase6.apache.org,44517,1690201659253': 2023-07-24 12:28:25,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,44517,1690201659253' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-24 12:28:25,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:25,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:25,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:25,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:25,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:25,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:25,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:25,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase6.apache.org,36595,1690201659396': 2023-07-24 12:28:25,249 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,36595,1690201659396' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-24 12:28:25,249 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-24 12:28:25,249 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 12:28:25,249 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 12:28:25,249 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,249 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 12:28:25,251 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,251 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:25,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:25,251 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,251 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,251 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:25,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,251 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:25,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,252 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,251 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:25,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:25,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:25,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:25,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:25,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:25,252 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:25,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:25,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,253 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:25,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:25,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:25,255 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:25,255 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,256 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:25,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:25,259 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:25,259 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:25,259 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:25,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:25,259 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,259 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:25,259 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:25,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:25,259 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,259 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:25,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:25,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:25,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:25,259 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:25,259 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:25,260 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,259 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,259 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:28:25,260 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-24 12:28:25,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:25,260 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,260 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:25,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 12:28:25,261 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:25,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:25,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:25,261 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:25,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:25,261 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,262 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,262 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,262 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 12:28:25,269 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,270 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,289 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,310 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-24 12:28:25,310 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,310 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:25,310 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690201705106Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1690201705269 (+163 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1690201705269Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1690201705270 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1690201705275 (+5 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1690201705283 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690201705310 (+27 ms) 2023-07-24 12:28:25,315 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 12:28:25,317 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 208 msec 2023-07-24 12:28:25,414 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:28:25,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 12:28:25,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 12:28:25,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36595] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 12:28:25,419 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44517] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 12:28:25,422 DEBUG [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-24 12:28:25,422 DEBUG [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5. 2023-07-24 12:28:25,423 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 12:28:25,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1583): Client=jenkins//172.31.2.20 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 12:28:25,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690201705433 (current time:1690201705433). 2023-07-24 12:28:25,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 12:28:25,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(139): Connect 0x181828b8 to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:28:25,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d016712, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:28:25,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:28:25,452 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:49034, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:28:25,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x181828b8 to 127.0.0.1:49553 2023-07-24 12:28:25,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:28:25,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(139): Connect 0x72407a83 to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:28:25,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bc4c19b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:28:25,468 DEBUG [hconnection-0x7dab1a06-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:28:25,470 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:49040, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:28:25,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:28:25,475 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:56234, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:28:25,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72407a83 to 127.0.0.1:49553 2023-07-24 12:28:25,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:28:25,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 12:28:25,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 12:28:25,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 12:28:25,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 12:28:25,481 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 12:28:25,482 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690202305482 2023-07-24 12:28:25,482 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-24 12:28:25,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 12:28:25,483 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 12:28:25,483 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 12:28:25,484 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 12:28:25,484 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 12:28:25,485 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-24 12:28:25,486 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 12:28:25,487 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690202305487 2023-07-24 12:28:25,500 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-24 12:28:25,500 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-24 12:28:25,500 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:28:25,501 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-24 12:28:25,501 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-24 12:28:25,502 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,502 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,503 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:25,503 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:25,503 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:25,503 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:25,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:25,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:25,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:25,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:25,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:25,504 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,504 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,504 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,504 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 12:28:25,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,505 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 12:28:25,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 12:28:25,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 12:28:25,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,505 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 12:28:25,505 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 12:28:25,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,505 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 12:28:25,505 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 12:28:25,506 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 12:28:25,506 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 12:28:25,506 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 12:28:25,506 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:28:25,506 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 12:28:25,507 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 12:28:25,507 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 12:28:25,507 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:28:25,506 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:28:25,508 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 12:28:25,509 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 12:28:25,507 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 12:28:25,509 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44517,1690201659253' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 12:28:25,509 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 12:28:25,509 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 12:28:25,509 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44275,1690201659331' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 12:28:25,509 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,36595,1690201659396' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 12:28:25,511 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,511 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:25,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:25,511 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,511 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,512 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:25,512 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:28:25,512 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,512 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,512 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:28:25,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:25,512 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,512 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:28:25,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 12:28:25,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:25,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:25,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,44517,1690201659253' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-24 12:28:25,514 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6701fe7e[Count = 1] remaining members to acquire global barrier 2023-07-24 12:28:25,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:25,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:25,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:25,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:25,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 12:28:25,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:25,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:25,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,36595,1690201659396' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-24 12:28:25,516 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6701fe7e[Count = 0] remaining members to acquire global barrier 2023-07-24 12:28:25,516 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-24 12:28:25,516 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,518 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,518 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,518 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,518 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,518 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 12:28:25,518 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,518 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 12:28:25,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,519 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 12:28:25,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,519 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5. 2023-07-24 12:28:25,519 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 12:28:25,519 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5. started... 2023-07-24 12:28:25,519 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,519 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 12:28:25,519 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 12:28:25,519 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 12:28:25,519 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 12:28:25,519 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 12:28:25,519 INFO [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2b76177242f5cd392041577927d0faa5 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-24 12:28:25,519 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba. 2023-07-24 12:28:25,519 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase6.apache.org,44275,1690201659331' in zk 2023-07-24 12:28:25,519 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba. started... 2023-07-24 12:28:25,520 INFO [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a0cad1ce4789583e3d7314804dd9c0ba 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-24 12:28:25,522 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 12:28:25,522 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:28:25,522 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 12:28:25,544 INFO [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307246b3b7402c8904b5091cadb42f6ad5132 to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307246b3b7402c8904b5091cadb42f6ad5132 2023-07-24 12:28:25,544 INFO [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230724e228d7198877459ba468f2c908c520f8 to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230724e228d7198877459ba468f2c908c520f8 2023-07-24 12:28:25,561 INFO [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testConsecutiveExports/a0cad1ce4789583e3d7314804dd9c0ba/.tmp/cf/2552bf6b5f5d415e89315db7200f475d 2023-07-24 12:28:25,561 INFO [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testConsecutiveExports/2b76177242f5cd392041577927d0faa5/.tmp/cf/e842442e3f4749b38ee94497f61e3bde 2023-07-24 12:28:25,567 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testConsecutiveExports/2b76177242f5cd392041577927d0faa5/.tmp/cf/e842442e3f4749b38ee94497f61e3bde as hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testConsecutiveExports/2b76177242f5cd392041577927d0faa5/cf/e842442e3f4749b38ee94497f61e3bde 2023-07-24 12:28:25,568 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testConsecutiveExports/a0cad1ce4789583e3d7314804dd9c0ba/.tmp/cf/2552bf6b5f5d415e89315db7200f475d as hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testConsecutiveExports/a0cad1ce4789583e3d7314804dd9c0ba/cf/2552bf6b5f5d415e89315db7200f475d 2023-07-24 12:28:25,572 INFO [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testConsecutiveExports/2b76177242f5cd392041577927d0faa5/cf/e842442e3f4749b38ee94497f61e3bde, entries=3, sequenceid=6, filesize=5.4 K 2023-07-24 12:28:25,573 INFO [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testConsecutiveExports/a0cad1ce4789583e3d7314804dd9c0ba/cf/2552bf6b5f5d415e89315db7200f475d, entries=47, sequenceid=6, filesize=12.7 K 2023-07-24 12:28:25,573 INFO [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 2b76177242f5cd392041577927d0faa5 in 54ms, sequenceid=6, compaction requested=false 2023-07-24 12:28:25,573 INFO [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for a0cad1ce4789583e3d7314804dd9c0ba in 54ms, sequenceid=6, compaction requested=false 2023-07-24 12:28:25,574 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-24 12:28:25,574 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-24 12:28:25,575 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2b76177242f5cd392041577927d0faa5: 2023-07-24 12:28:25,575 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a0cad1ce4789583e3d7314804dd9c0ba: 2023-07-24 12:28:25,575 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 12:28:25,575 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 12:28:25,576 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 12:28:25,576 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 12:28:25,576 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testConsecutiveExports/2b76177242f5cd392041577927d0faa5/cf/e842442e3f4749b38ee94497f61e3bde] hfiles 2023-07-24 12:28:25,576 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testConsecutiveExports/a0cad1ce4789583e3d7314804dd9c0ba/cf/2552bf6b5f5d415e89315db7200f475d] hfiles 2023-07-24 12:28:25,576 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testConsecutiveExports/a0cad1ce4789583e3d7314804dd9c0ba/cf/2552bf6b5f5d415e89315db7200f475d for snapshot=snaptb0-testConsecutiveExports 2023-07-24 12:28:25,576 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testConsecutiveExports/2b76177242f5cd392041577927d0faa5/cf/e842442e3f4749b38ee94497f61e3bde for snapshot=snaptb0-testConsecutiveExports 2023-07-24 12:28:25,583 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:28:25,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 12:28:25,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:28:25,584 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 12:28:25,592 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5. completed. 2023-07-24 12:28:25,592 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5. 2023-07-24 12:28:25,592 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 12:28:25,592 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 12:28:25,592 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,592 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 12:28:25,592 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase6.apache.org,36595,1690201659396' in zk 2023-07-24 12:28:25,593 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba. completed. 2023-07-24 12:28:25,593 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba. 2023-07-24 12:28:25,593 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 12:28:25,593 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 12:28:25,593 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,593 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 12:28:25,593 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase6.apache.org,44517,1690201659253' in zk 2023-07-24 12:28:25,594 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,594 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 12:28:25,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:25,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:25,594 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:28:25,595 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 12:28:25,596 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 12:28:25,596 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:25,596 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:28:25,596 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 12:28:25,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:25,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 12:28:25,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:25,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:25,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 12:28:25,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:25,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase6.apache.org,36595,1690201659396': 2023-07-24 12:28:25,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,36595,1690201659396' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-24 12:28:25,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:25,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:25,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:25,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:25,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 12:28:25,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:25,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:25,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 12:28:25,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:25,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase6.apache.org,44517,1690201659253': 2023-07-24 12:28:25,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,44517,1690201659253' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-24 12:28:25,607 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-24 12:28:25,607 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 12:28:25,607 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 12:28:25,607 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-24 12:28:25,607 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 12:28:25,612 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,612 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,613 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:25,612 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,612 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:25,612 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,613 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:25,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:25,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:25,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:25,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,613 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:25,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:25,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:25,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:25,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:25,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,614 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,615 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:25,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:25,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 12:28:25,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:25,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 12:28:25,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,618 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,618 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:25,618 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:25,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:25,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 12:28:25,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:25,626 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:25,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:25,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:25,626 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:25,626 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:25,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:25,626 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:25,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:25,626 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:25,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:25,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:25,626 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,627 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,627 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,627 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,627 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:25,627 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,627 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:28:25,626 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:25,627 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-24 12:28:25,627 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:25,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:25,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:25,629 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-24 12:28:25,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:25,629 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:25,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:25,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 12:28:25,629 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:25,630 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,630 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,630 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 12:28:25,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:25,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:25,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307246b3b7402c8904b5091cadb42f6ad5132, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230724e228d7198877459ba468f2c908c520f8] mob files 2023-07-24 12:28:25,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307246b3b7402c8904b5091cadb42f6ad5132 2023-07-24 12:28:25,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230724e228d7198877459ba468f2c908c520f8 2023-07-24 12:28:25,632 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports because node does not exist (not an error) 2023-07-24 12:28:25,658 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-24 12:28:25,659 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,718 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-24 12:28:25,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,718 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690201705482Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1690201705658 (+176 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1690201705658Loading Region manifests for snaptb0-testConsecutiveExports at 1690201705658Writing data manifest for snaptb0-testConsecutiveExports at 1690201705666 (+8 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1690201705688 (+22 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690201705718 (+30 ms) 2023-07-24 12:28:25,721 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 12:28:25,722 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 238 msec 2023-07-24 12:28:25,784 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:28:25,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 12:28:25,785 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 12:28:25,786 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/local-export-1690201705786 2023-07-24 12:28:25,786 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/local-export-1690201705786, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/local-export-1690201705786, srcFsUri=hdfs://localhost:42387, srcDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa 2023-07-24 12:28:25,808 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42387, inputRoot=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa 2023-07-24 12:28:25,808 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@5bb524d9, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/local-export-1690201705786, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/local-export-1690201705786/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,808 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42387, inputRoot=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa, snapshotDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-24 12:28:25,816 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/local-export-1690201705786/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 12:28:25,827 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:25,828 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:25,828 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:25,828 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:25,829 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:25,829 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:25,829 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:25,902 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/hadoop-2047285012336354225.jar 2023-07-24 12:28:25,903 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:25,903 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:25,904 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:25,904 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:25,904 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:25,904 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:25,905 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 12:28:25,905 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 12:28:25,906 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 12:28:25,906 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 12:28:25,906 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 12:28:25,907 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 12:28:25,907 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 12:28:25,907 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 12:28:25,908 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 12:28:25,908 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 12:28:25,908 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:28:25,909 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:28:25,909 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 12:28:25,909 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:28:25,910 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:28:25,910 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 12:28:25,910 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 12:28:26,276 WARN [Listener at jenkins-hbase6.apache.org/41373] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 12:28:26,278 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-24 12:28:26,280 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-24 12:28:28,645 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 12:28:28,645 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 12:28:28,648 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0002_000001 (auth:SIMPLE) 2023-07-24 12:28:29,174 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0003_000001 (auth:SIMPLE) 2023-07-24 12:28:29,753 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 12:28:33,560 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0003_000001 (auth:SIMPLE) 2023-07-24 12:28:35,819 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0003_000001 (auth:SIMPLE) 2023-07-24 12:28:38,784 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0003_000001 (auth:SIMPLE) 2023-07-24 12:28:40,447 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 12:28:40,447 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 12:28:40,451 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-24 12:28:40,451 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 12:28:40,452 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 12:28:40,452 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1338397176_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 12:28:40,453 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 12:28:40,453 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 12:28:40,453 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@db78aa9 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/local-export-1690201705786/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/local-export-1690201705786/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 12:28:40,453 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/local-export-1690201705786/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 12:28:40,453 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/local-export-1690201705786/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 12:28:40,454 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/local-export-1690201705786, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/local-export-1690201705786, srcFsUri=hdfs://localhost:42387, srcDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa 2023-07-24 12:28:40,475 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42387, inputRoot=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa 2023-07-24 12:28:40,476 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7e7b914d, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/local-export-1690201705786, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/local-export-1690201705786/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 12:28:40,476 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42387, inputRoot=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa, snapshotDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-24 12:28:40,488 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/local-export-1690201705786/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 12:28:40,500 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:40,500 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:40,500 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:40,501 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:40,501 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:40,501 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:40,502 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:40,571 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/hadoop-8563198681166882336.jar 2023-07-24 12:28:40,571 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:40,572 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:40,572 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:40,572 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:40,573 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:40,573 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 12:28:40,573 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 12:28:40,574 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 12:28:40,574 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 12:28:40,574 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 12:28:40,575 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 12:28:40,575 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 12:28:40,575 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 12:28:40,576 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 12:28:40,576 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 12:28:40,577 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 12:28:40,577 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:28:40,577 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:28:40,578 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 12:28:40,578 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:28:40,578 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:28:40,578 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 12:28:40,579 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 12:28:40,952 WARN [Listener at jenkins-hbase6.apache.org/41373] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 12:28:40,954 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-24 12:28:40,956 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-24 12:28:44,971 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 12:28:44,972 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 12:28:44,975 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0003_000001 (auth:SIMPLE) 2023-07-24 12:28:45,778 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0004_000001 (auth:SIMPLE) 2023-07-24 12:28:50,039 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0004_000001 (auth:SIMPLE) 2023-07-24 12:28:52,294 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0004_000001 (auth:SIMPLE) 2023-07-24 12:28:54,987 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0004_000001 (auth:SIMPLE) 2023-07-24 12:28:56,158 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 12:28:56,158 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 12:28:56,167 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-24 12:28:56,167 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 12:28:56,167 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 12:28:56,168 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1338397176_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 12:28:56,173 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 12:28:56,173 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 12:28:56,173 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@db78aa9 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/local-export-1690201705786/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/local-export-1690201705786/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 12:28:56,174 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/local-export-1690201705786/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 12:28:56,174 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/local-export-1690201705786/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 12:28:56,192 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-24 12:28:56,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.HMaster$11(2418): Client=jenkins//172.31.2.20 disable testtb-testConsecutiveExports 2023-07-24 12:28:56,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-24 12:28:56,206 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201736206"}]},"ts":"1690201736206"} 2023-07-24 12:28:56,208 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-24 12:28:56,210 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-24 12:28:56,211 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2b76177242f5cd392041577927d0faa5, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a0cad1ce4789583e3d7314804dd9c0ba, UNASSIGN}] 2023-07-24 12:28:56,212 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a0cad1ce4789583e3d7314804dd9c0ba, UNASSIGN 2023-07-24 12:28:56,214 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2b76177242f5cd392041577927d0faa5, UNASSIGN 2023-07-24 12:28:56,215 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=a0cad1ce4789583e3d7314804dd9c0ba, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:56,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 12:28:56,216 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690201736215"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201736215"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201736215"}]},"ts":"1690201736215"} 2023-07-24 12:28:56,216 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=2b76177242f5cd392041577927d0faa5, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:56,216 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690201736216"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201736216"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201736216"}]},"ts":"1690201736216"} 2023-07-24 12:28:56,217 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure a0cad1ce4789583e3d7314804dd9c0ba, server=jenkins-hbase6.apache.org,44517,1690201659253}] 2023-07-24 12:28:56,218 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 2b76177242f5cd392041577927d0faa5, server=jenkins-hbase6.apache.org,36595,1690201659396}] 2023-07-24 12:28:56,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 12:28:56,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(111): Close a0cad1ce4789583e3d7314804dd9c0ba 2023-07-24 12:28:56,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing a0cad1ce4789583e3d7314804dd9c0ba, disabling compactions & flushes 2023-07-24 12:28:56,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba. 2023-07-24 12:28:56,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba. 2023-07-24 12:28:56,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba. after waiting 0 ms 2023-07-24 12:28:56,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba. 2023-07-24 12:28:56,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(111): Close 2b76177242f5cd392041577927d0faa5 2023-07-24 12:28:56,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 2b76177242f5cd392041577927d0faa5, disabling compactions & flushes 2023-07-24 12:28:56,371 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5. 2023-07-24 12:28:56,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5. 2023-07-24 12:28:56,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5. after waiting 0 ms 2023-07-24 12:28:56,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5. 2023-07-24 12:28:56,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testConsecutiveExports/2b76177242f5cd392041577927d0faa5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 12:28:56,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testConsecutiveExports/a0cad1ce4789583e3d7314804dd9c0ba/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 12:28:56,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 12:28:56,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5. 2023-07-24 12:28:56,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 2b76177242f5cd392041577927d0faa5: 2023-07-24 12:28:56,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 12:28:56,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba. 2023-07-24 12:28:56,398 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for a0cad1ce4789583e3d7314804dd9c0ba: 2023-07-24 12:28:56,400 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(149): Closed 2b76177242f5cd392041577927d0faa5 2023-07-24 12:28:56,401 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=2b76177242f5cd392041577927d0faa5, regionState=CLOSED 2023-07-24 12:28:56,401 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690201736401"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201736401"}]},"ts":"1690201736401"} 2023-07-24 12:28:56,401 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(149): Closed a0cad1ce4789583e3d7314804dd9c0ba 2023-07-24 12:28:56,402 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=a0cad1ce4789583e3d7314804dd9c0ba, regionState=CLOSED 2023-07-24 12:28:56,402 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690201736402"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201736402"}]},"ts":"1690201736402"} 2023-07-24 12:28:56,407 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-24 12:28:56,407 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 2b76177242f5cd392041577927d0faa5, server=jenkins-hbase6.apache.org,36595,1690201659396 in 186 msec 2023-07-24 12:28:56,408 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-24 12:28:56,408 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure a0cad1ce4789583e3d7314804dd9c0ba, server=jenkins-hbase6.apache.org,44517,1690201659253 in 188 msec 2023-07-24 12:28:56,409 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2b76177242f5cd392041577927d0faa5, UNASSIGN in 196 msec 2023-07-24 12:28:56,410 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-24 12:28:56,410 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=a0cad1ce4789583e3d7314804dd9c0ba, UNASSIGN in 197 msec 2023-07-24 12:28:56,411 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201736411"}]},"ts":"1690201736411"} 2023-07-24 12:28:56,413 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-24 12:28:56,414 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-24 12:28:56,417 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 222 msec 2023-07-24 12:28:56,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 12:28:56,518 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-24 12:28:56,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.HMaster$5(2228): Client=jenkins//172.31.2.20 delete testtb-testConsecutiveExports 2023-07-24 12:28:56,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 12:28:56,524 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 12:28:56,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-24 12:28:56,528 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 12:28:56,539 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36595] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-24 12:28:56,542 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 12:28:56,542 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 12:28:56,542 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 12:28:56,545 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 12:28:56,545 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 12:28:56,546 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 12:28:56,545 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 12:28:56,546 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 12:28:56,546 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testConsecutiveExports/2b76177242f5cd392041577927d0faa5 2023-07-24 12:28:56,547 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 12:28:56,547 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:28:56,547 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 12:28:56,547 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:28:56,547 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 12:28:56,547 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:28:56,547 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 12:28:56,547 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:28:56,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-24 12:28:56,552 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testConsecutiveExports/a0cad1ce4789583e3d7314804dd9c0ba 2023-07-24 12:28:56,553 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testConsecutiveExports/2b76177242f5cd392041577927d0faa5/cf, FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testConsecutiveExports/2b76177242f5cd392041577927d0faa5/recovered.edits] 2023-07-24 12:28:56,554 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testConsecutiveExports/a0cad1ce4789583e3d7314804dd9c0ba/cf, FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testConsecutiveExports/a0cad1ce4789583e3d7314804dd9c0ba/recovered.edits] 2023-07-24 12:28:56,560 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testConsecutiveExports/2b76177242f5cd392041577927d0faa5/cf/e842442e3f4749b38ee94497f61e3bde to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testConsecutiveExports/2b76177242f5cd392041577927d0faa5/cf/e842442e3f4749b38ee94497f61e3bde 2023-07-24 12:28:56,566 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testConsecutiveExports/a0cad1ce4789583e3d7314804dd9c0ba/cf/2552bf6b5f5d415e89315db7200f475d to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testConsecutiveExports/a0cad1ce4789583e3d7314804dd9c0ba/cf/2552bf6b5f5d415e89315db7200f475d 2023-07-24 12:28:56,568 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testConsecutiveExports/2b76177242f5cd392041577927d0faa5/recovered.edits/9.seqid to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testConsecutiveExports/2b76177242f5cd392041577927d0faa5/recovered.edits/9.seqid 2023-07-24 12:28:56,570 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testConsecutiveExports/2b76177242f5cd392041577927d0faa5 2023-07-24 12:28:56,574 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testConsecutiveExports/a0cad1ce4789583e3d7314804dd9c0ba/recovered.edits/9.seqid to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testConsecutiveExports/a0cad1ce4789583e3d7314804dd9c0ba/recovered.edits/9.seqid 2023-07-24 12:28:56,575 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testConsecutiveExports/a0cad1ce4789583e3d7314804dd9c0ba 2023-07-24 12:28:56,575 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-24 12:28:56,575 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-24 12:28:56,576 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-24 12:28:56,583 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307246b3b7402c8904b5091cadb42f6ad5132 to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307246b3b7402c8904b5091cadb42f6ad5132 2023-07-24 12:28:56,585 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230724e228d7198877459ba468f2c908c520f8 to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230724e228d7198877459ba468f2c908c520f8 2023-07-24 12:28:56,586 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-24 12:28:56,590 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 12:28:56,594 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-24 12:28:56,596 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-24 12:28:56,599 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 12:28:56,599 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-24 12:28:56,599 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690201736599"}]},"ts":"9223372036854775807"} 2023-07-24 12:28:56,599 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690201736599"}]},"ts":"9223372036854775807"} 2023-07-24 12:28:56,612 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 12:28:56,612 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2b76177242f5cd392041577927d0faa5, NAME => 'testtb-testConsecutiveExports,,1690201704449.2b76177242f5cd392041577927d0faa5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a0cad1ce4789583e3d7314804dd9c0ba, NAME => 'testtb-testConsecutiveExports,1,1690201704449.a0cad1ce4789583e3d7314804dd9c0ba.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 12:28:56,612 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-24 12:28:56,613 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690201736612"}]},"ts":"9223372036854775807"} 2023-07-24 12:28:56,616 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-24 12:28:56,619 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 12:28:56,621 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 99 msec 2023-07-24 12:28:56,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-24 12:28:56,650 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-24 12:28:56,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(751): Client=jenkins//172.31.2.20 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-24 12:28:56,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-24 12:28:56,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(751): Client=jenkins//172.31.2.20 delete name: "snaptb0-testConsecutiveExports" 2023-07-24 12:28:56,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-24 12:28:56,704 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=746 (was 765), OpenFileDescriptor=903 (was 929), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=407 (was 347) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 177) - ProcessCount LEAK? -, AvailableMemoryMB=1491 (was 954) - AvailableMemoryMB LEAK? - 2023-07-24 12:28:56,704 WARN [Listener at jenkins-hbase6.apache.org/41373] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-24 12:28:56,732 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=746, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=407, ProcessCount=179, AvailableMemoryMB=1484 2023-07-24 12:28:56,732 WARN [Listener at jenkins-hbase6.apache.org/41373] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-24 12:28:56,735 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.HMaster$4(2112): Client=jenkins//172.31.2.20 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 12:28:56,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:56,739 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 12:28:56,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(700): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-24 12:28:56,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 12:28:56,747 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 12:28:56,751 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f073fac22553ddc64db3e7fc2811e7c2 2023-07-24 12:28:56,756 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f073fac22553ddc64db3e7fc2811e7c2 empty. 2023-07-24 12:28:56,757 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f073fac22553ddc64db3e7fc2811e7c2 2023-07-24 12:28:56,766 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/90ebd46f45b7225dbe4c67ee88719c37 2023-07-24 12:28:56,767 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/90ebd46f45b7225dbe4c67ee88719c37 empty. 2023-07-24 12:28:56,768 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/90ebd46f45b7225dbe4c67ee88719c37 2023-07-24 12:28:56,768 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-24 12:28:56,799 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-24 12:28:56,804 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => f073fac22553ddc64db3e7fc2811e7c2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp 2023-07-24 12:28:56,804 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 90ebd46f45b7225dbe4c67ee88719c37, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp 2023-07-24 12:28:56,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 12:28:56,848 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:28:56,849 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 90ebd46f45b7225dbe4c67ee88719c37, disabling compactions & flushes 2023-07-24 12:28:56,849 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37. 2023-07-24 12:28:56,849 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37. 2023-07-24 12:28:56,849 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37. after waiting 0 ms 2023-07-24 12:28:56,849 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37. 2023-07-24 12:28:56,849 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37. 2023-07-24 12:28:56,849 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 90ebd46f45b7225dbe4c67ee88719c37: 2023-07-24 12:28:56,851 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:28:56,851 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing f073fac22553ddc64db3e7fc2811e7c2, disabling compactions & flushes 2023-07-24 12:28:56,851 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2. 2023-07-24 12:28:56,851 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2. 2023-07-24 12:28:56,851 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2. after waiting 0 ms 2023-07-24 12:28:56,851 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2. 2023-07-24 12:28:56,851 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2. 2023-07-24 12:28:56,851 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for f073fac22553ddc64db3e7fc2811e7c2: 2023-07-24 12:28:56,854 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 12:28:56,855 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690201736855"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201736855"}]},"ts":"1690201736855"} 2023-07-24 12:28:56,856 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690201736855"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201736855"}]},"ts":"1690201736855"} 2023-07-24 12:28:56,895 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 12:28:56,897 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 12:28:56,898 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201736898"}]},"ts":"1690201736898"} 2023-07-24 12:28:56,902 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-24 12:28:56,909 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-07-24 12:28:56,910 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 12:28:56,910 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 12:28:56,910 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 12:28:56,910 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 12:28:56,910 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f073fac22553ddc64db3e7fc2811e7c2, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=90ebd46f45b7225dbe4c67ee88719c37, ASSIGN}] 2023-07-24 12:28:56,913 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=90ebd46f45b7225dbe4c67ee88719c37, ASSIGN 2023-07-24 12:28:56,914 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f073fac22553ddc64db3e7fc2811e7c2, ASSIGN 2023-07-24 12:28:56,915 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=90ebd46f45b7225dbe4c67ee88719c37, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,44517,1690201659253; forceNewPlan=false, retain=false 2023-07-24 12:28:56,916 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f073fac22553ddc64db3e7fc2811e7c2, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,36595,1690201659396; forceNewPlan=false, retain=false 2023-07-24 12:28:57,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 12:28:57,065 INFO [jenkins-hbase6:38215] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 12:28:57,069 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=f073fac22553ddc64db3e7fc2811e7c2, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:57,069 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=90ebd46f45b7225dbe4c67ee88719c37, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:57,069 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690201737068"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201737068"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201737068"}]},"ts":"1690201737068"} 2023-07-24 12:28:57,069 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690201737068"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201737068"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201737068"}]},"ts":"1690201737068"} 2023-07-24 12:28:57,071 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 90ebd46f45b7225dbe4c67ee88719c37, server=jenkins-hbase6.apache.org,44517,1690201659253}] 2023-07-24 12:28:57,072 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure f073fac22553ddc64db3e7fc2811e7c2, server=jenkins-hbase6.apache.org,36595,1690201659396}] 2023-07-24 12:28:57,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37. 2023-07-24 12:28:57,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 90ebd46f45b7225dbe4c67ee88719c37, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 12:28:57,229 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2. 2023-07-24 12:28:57,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37. service=AccessControlService 2023-07-24 12:28:57,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f073fac22553ddc64db3e7fc2811e7c2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 12:28:57,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 12:28:57,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2. service=AccessControlService 2023-07-24 12:28:57,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 90ebd46f45b7225dbe4c67ee88719c37 2023-07-24 12:28:57,230 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 12:28:57,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:28:57,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion f073fac22553ddc64db3e7fc2811e7c2 2023-07-24 12:28:57,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 90ebd46f45b7225dbe4c67ee88719c37 2023-07-24 12:28:57,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:28:57,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 90ebd46f45b7225dbe4c67ee88719c37 2023-07-24 12:28:57,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for f073fac22553ddc64db3e7fc2811e7c2 2023-07-24 12:28:57,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for f073fac22553ddc64db3e7fc2811e7c2 2023-07-24 12:28:57,231 INFO [StoreOpener-90ebd46f45b7225dbe4c67ee88719c37-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 90ebd46f45b7225dbe4c67ee88719c37 2023-07-24 12:28:57,232 INFO [StoreOpener-f073fac22553ddc64db3e7fc2811e7c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f073fac22553ddc64db3e7fc2811e7c2 2023-07-24 12:28:57,233 DEBUG [StoreOpener-90ebd46f45b7225dbe4c67ee88719c37-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion/90ebd46f45b7225dbe4c67ee88719c37/cf 2023-07-24 12:28:57,234 DEBUG [StoreOpener-f073fac22553ddc64db3e7fc2811e7c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion/f073fac22553ddc64db3e7fc2811e7c2/cf 2023-07-24 12:28:57,234 DEBUG [StoreOpener-f073fac22553ddc64db3e7fc2811e7c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion/f073fac22553ddc64db3e7fc2811e7c2/cf 2023-07-24 12:28:57,234 DEBUG [StoreOpener-90ebd46f45b7225dbe4c67ee88719c37-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion/90ebd46f45b7225dbe4c67ee88719c37/cf 2023-07-24 12:28:57,235 INFO [StoreOpener-f073fac22553ddc64db3e7fc2811e7c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f073fac22553ddc64db3e7fc2811e7c2 columnFamilyName cf 2023-07-24 12:28:57,236 INFO [StoreOpener-f073fac22553ddc64db3e7fc2811e7c2-1] regionserver.HStore(310): Store=f073fac22553ddc64db3e7fc2811e7c2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 12:28:57,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion/f073fac22553ddc64db3e7fc2811e7c2 2023-07-24 12:28:57,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion/f073fac22553ddc64db3e7fc2811e7c2 2023-07-24 12:28:57,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for f073fac22553ddc64db3e7fc2811e7c2 2023-07-24 12:28:57,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion/f073fac22553ddc64db3e7fc2811e7c2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 12:28:57,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened f073fac22553ddc64db3e7fc2811e7c2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69706873, jitterRate=0.038713350892066956}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 12:28:57,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for f073fac22553ddc64db3e7fc2811e7c2: 2023-07-24 12:28:57,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2., pid=61, masterSystemTime=1690201737225 2023-07-24 12:28:57,246 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2. 2023-07-24 12:28:57,246 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2. 2023-07-24 12:28:57,247 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=f073fac22553ddc64db3e7fc2811e7c2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:57,248 INFO [StoreOpener-90ebd46f45b7225dbe4c67ee88719c37-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 90ebd46f45b7225dbe4c67ee88719c37 columnFamilyName cf 2023-07-24 12:28:57,248 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690201737247"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690201737247"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690201737247"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690201737247"}]},"ts":"1690201737247"} 2023-07-24 12:28:57,252 INFO [StoreOpener-90ebd46f45b7225dbe4c67ee88719c37-1] regionserver.HStore(310): Store=90ebd46f45b7225dbe4c67ee88719c37/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 12:28:57,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion/90ebd46f45b7225dbe4c67ee88719c37 2023-07-24 12:28:57,253 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion/90ebd46f45b7225dbe4c67ee88719c37 2023-07-24 12:28:57,254 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=58 2023-07-24 12:28:57,254 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure f073fac22553ddc64db3e7fc2811e7c2, server=jenkins-hbase6.apache.org,36595,1690201659396 in 180 msec 2023-07-24 12:28:57,256 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f073fac22553ddc64db3e7fc2811e7c2, ASSIGN in 344 msec 2023-07-24 12:28:57,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 90ebd46f45b7225dbe4c67ee88719c37 2023-07-24 12:28:57,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion/90ebd46f45b7225dbe4c67ee88719c37/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 12:28:57,263 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 90ebd46f45b7225dbe4c67ee88719c37; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64236497, jitterRate=-0.04280160367488861}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 12:28:57,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 90ebd46f45b7225dbe4c67ee88719c37: 2023-07-24 12:28:57,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37., pid=60, masterSystemTime=1690201737224 2023-07-24 12:28:57,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37. 2023-07-24 12:28:57,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37. 2023-07-24 12:28:57,276 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=90ebd46f45b7225dbe4c67ee88719c37, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:57,276 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690201737276"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690201737276"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690201737276"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690201737276"}]},"ts":"1690201737276"} 2023-07-24 12:28:57,280 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-07-24 12:28:57,280 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 90ebd46f45b7225dbe4c67ee88719c37, server=jenkins-hbase6.apache.org,44517,1690201659253 in 207 msec 2023-07-24 12:28:57,282 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-24 12:28:57,282 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=90ebd46f45b7225dbe4c67ee88719c37, ASSIGN in 370 msec 2023-07-24 12:28:57,283 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 12:28:57,283 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201737283"}]},"ts":"1690201737283"} 2023-07-24 12:28:57,285 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-24 12:28:57,287 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 12:28:57,288 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-24 12:28:57,290 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36595] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 12:28:57,291 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:28:57,291 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:28:57,291 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:28:57,291 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:28:57,292 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 12:28:57,293 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 12:28:57,294 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 12:28:57,294 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 12:28:57,294 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 558 msec 2023-07-24 12:28:57,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 12:28:57,345 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-24 12:28:57,358 DEBUG [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,358 DEBUG [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2. 2023-07-24 12:28:57,363 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 12:28:57,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1583): Client=jenkins//172.31.2.20 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 12:28:57,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690201737431 (current time:1690201737431). 2023-07-24 12:28:57,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 12:28:57,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(139): Connect 0x7eff0eb0 to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:28:57,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31a8fc49, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:28:57,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:28:57,493 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:56540, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:28:57,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7eff0eb0 to 127.0.0.1:49553 2023-07-24 12:28:57,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:28:57,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(139): Connect 0x13c60d0b to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:28:57,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@154a1b4d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:28:57,548 DEBUG [hconnection-0x63f6f719-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:28:57,549 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:56544, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:28:57,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:28:57,559 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:53240, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:28:57,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13c60d0b to 127.0.0.1:49553 2023-07-24 12:28:57,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:28:57,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 12:28:57,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 12:28:57,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 12:28:57,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 12:28:57,566 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 12:28:57,567 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690202337567 2023-07-24 12:28:57,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 12:28:57,568 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,569 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 12:28:57,570 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 12:28:57,572 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 12:28:57,572 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 12:28:57,574 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 9 msec 2023-07-24 12:28:57,578 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 12:28:57,579 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690202337579 2023-07-24 12:28:57,646 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,646 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-24 12:28:57,646 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:28:57,650 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-24 12:28:57,650 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-24 12:28:57,664 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,665 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,668 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:57,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:57,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:57,668 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:57,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,668 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:57,669 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:57,669 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,669 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:57,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:57,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:57,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 12:28:57,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,669 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:57,669 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 12:28:57,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:57,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:57,670 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:57,670 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 12:28:57,670 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:28:57,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,671 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 12:28:57,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 12:28:57,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,671 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:28:57,672 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 12:28:57,671 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 12:28:57,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 12:28:57,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,672 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 12:28:57,679 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,679 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 12:28:57,679 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:28:57,679 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,680 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 12:28:57,680 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:28:57,690 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,692 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 12:28:57,692 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:28:57,692 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 12:28:57,694 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 12:28:57,694 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44517,1690201659253' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 12:28:57,692 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 12:28:57,694 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 12:28:57,694 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44275,1690201659331' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 12:28:57,694 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 12:28:57,695 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 12:28:57,695 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,36595,1690201659396' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 12:28:57,696 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,697 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:57,697 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:57,697 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:57,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:57,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:57,697 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,698 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,698 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:28:57,698 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,698 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:28:57,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:57,698 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,698 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:28:57,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:57,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:57,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:57,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:57,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:57,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,44517,1690201659253' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 12:28:57,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11781746[Count = 1] remaining members to acquire global barrier 2023-07-24 12:28:57,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:57,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:57,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:57,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:57,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:57,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:57,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:57,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:57,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:57,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,36595,1690201659396' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 12:28:57,720 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@11781746[Count = 0] remaining members to acquire global barrier 2023-07-24 12:28:57,720 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-24 12:28:57,720 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,727 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,727 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,728 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,728 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 12:28:57,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,728 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 12:28:57,728 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 12:28:57,728 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase6.apache.org,44275,1690201659331' in zk 2023-07-24 12:28:57,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,728 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 12:28:57,729 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:57,734 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 12:28:57,735 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 12:28:57,735 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37. 2023-07-24 12:28:57,735 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37. started... 2023-07-24 12:28:57,737 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 12:28:57,757 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2. 2023-07-24 12:28:57,757 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2. started... 2023-07-24 12:28:57,757 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 90ebd46f45b7225dbe4c67ee88719c37: 2023-07-24 12:28:57,757 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:57,757 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 12:28:57,757 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f073fac22553ddc64db3e7fc2811e7c2: 2023-07-24 12:28:57,757 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 12:28:57,757 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,758 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 12:28:57,758 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 12:28:57,757 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 12:28:57,758 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,759 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:28:57,759 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 12:28:57,759 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 12:28:57,759 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 12:28:57,833 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2. completed. 2023-07-24 12:28:57,833 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2. 2023-07-24 12:28:57,833 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37. completed. 2023-07-24 12:28:57,833 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37. 2023-07-24 12:28:57,833 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 12:28:57,833 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 12:28:57,833 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 12:28:57,833 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 12:28:57,833 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:57,833 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:57,833 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 12:28:57,833 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 12:28:57,833 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase6.apache.org,44517,1690201659253' in zk 2023-07-24 12:28:57,833 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase6.apache.org,36595,1690201659396' in zk 2023-07-24 12:28:57,836 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 12:28:57,836 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 12:28:57,836 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:28:57,836 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:28:57,838 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 12:28:57,836 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:57,839 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:57,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:57,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:57,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:57,837 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 12:28:57,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:57,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:57,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:57,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:57,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:57,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:57,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:57,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:57,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:57,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase6.apache.org,36595,1690201659396': 2023-07-24 12:28:57,847 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,36595,1690201659396' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-24 12:28:57,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:57,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:57,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:57,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:57,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:57,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:57,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:57,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:57,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:57,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:57,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:57,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:57,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase6.apache.org,44517,1690201659253': 2023-07-24 12:28:57,852 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,44517,1690201659253' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-24 12:28:57,852 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-24 12:28:57,852 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 12:28:57,852 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 12:28:57,852 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,852 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 12:28:57,854 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,854 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,854 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,854 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,854 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:57,854 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:57,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:57,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:57,854 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:57,855 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:57,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:57,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:57,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:57,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:57,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:57,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:57,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,856 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:57,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:57,856 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:57,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:57,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:57,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:57,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:57,859 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:57,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:57,859 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:57,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,859 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:57,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:57,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:57,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:57,863 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:57,863 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,863 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:57,863 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:57,863 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:57,863 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:57,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:57,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:57,863 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:28:57,863 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:57,863 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,863 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:57,863 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:57,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:57,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:57,863 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:57,863 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:57,863 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:57,863 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,865 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 12:28:57,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:57,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:57,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:57,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:57,865 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:57,867 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,867 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:57,867 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:57,867 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,867 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:57,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:57,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 12:28:57,872 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:28:57,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 12:28:57,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:28:57,873 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 12:28:57,910 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,911 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:57,963 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,014 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-24 12:28:58,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,015 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690201737568Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1690201737910 (+342 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690201737910Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690201737910Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690201737922 (+12 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690201737944 (+22 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690201738014 (+70 ms) 2023-07-24 12:28:58,017 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 12:28:58,019 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 448 msec 2023-07-24 12:28:58,174 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:28:58,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 12:28:58,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 12:28:58,178 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36595] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 12:28:58,180 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44517] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 12:28:58,185 DEBUG [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,185 DEBUG [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2. 2023-07-24 12:28:58,185 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 12:28:58,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1583): Client=jenkins//172.31.2.20 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 12:28:58,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690201738199 (current time:1690201738199). 2023-07-24 12:28:58,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 12:28:58,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(139): Connect 0x3f48e838 to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:28:58,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66580604, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:28:58,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:28:58,249 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:56556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:28:58,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f48e838 to 127.0.0.1:49553 2023-07-24 12:28:58,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:28:58,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(139): Connect 0x0cd070cc to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:28:58,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74214046, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:28:58,318 DEBUG [hconnection-0x526f00e0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:28:58,327 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:56564, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:28:58,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:28:58,341 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:53252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:28:58,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0cd070cc to 127.0.0.1:49553 2023-07-24 12:28:58,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:28:58,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 12:28:58,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 12:28:58,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 12:28:58,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 12:28:58,364 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 12:28:58,365 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690202338365 2023-07-24 12:28:58,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 12:28:58,366 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,366 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 12:28:58,366 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 12:28:58,369 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 12:28:58,370 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 12:28:58,372 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 19 msec 2023-07-24 12:28:58,373 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 12:28:58,374 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690202338374 2023-07-24 12:28:58,435 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,436 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-24 12:28:58,436 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:28:58,438 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-24 12:28:58,438 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-24 12:28:58,438 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,438 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,441 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:58,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:58,441 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:58,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:58,442 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:58,442 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:58,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,442 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:58,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:58,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:58,442 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:58,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:58,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:58,443 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,442 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:58,443 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 12:28:58,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 12:28:58,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,443 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 12:28:58,443 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,444 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,444 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,444 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 12:28:58,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 12:28:58,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 12:28:58,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,444 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 12:28:58,444 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 12:28:58,444 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:28:58,451 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,466 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:28:58,463 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,453 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 12:28:58,469 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 12:28:58,469 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:28:58,469 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 12:28:58,471 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 12:28:58,471 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 12:28:58,471 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:28:58,469 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 12:28:58,472 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 12:28:58,472 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 12:28:58,472 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44275,1690201659331' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 12:28:58,471 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,36595,1690201659396' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 12:28:58,472 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44517,1690201659253' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 12:28:58,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 12:28:58,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:28:58,475 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:58,475 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,476 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 12:28:58,476 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:58,477 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,477 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,477 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:28:58,478 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,478 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:28:58,478 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:58,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:58,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:58,479 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,479 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:28:58,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:58,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:58,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:58,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:58,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:58,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:58,482 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,36595,1690201659396' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 12:28:58,482 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19026c93[Count = 1] remaining members to acquire global barrier 2023-07-24 12:28:58,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:58,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:58,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:58,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:58,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:58,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:58,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:58,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:58,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:58,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,44517,1690201659253' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 12:28:58,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19026c93[Count = 0] remaining members to acquire global barrier 2023-07-24 12:28:58,492 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-24 12:28:58,492 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,494 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,494 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,494 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 12:28:58,494 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,495 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:58,495 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 12:28:58,495 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 12:28:58,495 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 12:28:58,495 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase6.apache.org,44275,1690201659331' in zk 2023-07-24 12:28:58,495 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 12:28:58,495 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 12:28:58,495 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37. 2023-07-24 12:28:58,496 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37. started... 2023-07-24 12:28:58,496 INFO [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 90ebd46f45b7225dbe4c67ee88719c37 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-24 12:28:58,496 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:58,496 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 12:28:58,497 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 12:28:58,497 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:28:58,497 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 12:28:58,503 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 12:28:58,503 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 12:28:58,503 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2. 2023-07-24 12:28:58,503 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2. started... 2023-07-24 12:28:58,504 INFO [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f073fac22553ddc64db3e7fc2811e7c2 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-24 12:28:58,564 INFO [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307249efbc8f507044a698b7cdceb6511e85c to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307249efbc8f507044a698b7cdceb6511e85c 2023-07-24 12:28:58,582 INFO [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion/f073fac22553ddc64db3e7fc2811e7c2/.tmp/cf/a23d25784bcc43c7ada0a53db7a55301 2023-07-24 12:28:58,589 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion/f073fac22553ddc64db3e7fc2811e7c2/.tmp/cf/a23d25784bcc43c7ada0a53db7a55301 as hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion/f073fac22553ddc64db3e7fc2811e7c2/cf/a23d25784bcc43c7ada0a53db7a55301 2023-07-24 12:28:58,595 INFO [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion/f073fac22553ddc64db3e7fc2811e7c2/cf/a23d25784bcc43c7ada0a53db7a55301, entries=5, sequenceid=6, filesize=5.8 K 2023-07-24 12:28:58,596 INFO [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for f073fac22553ddc64db3e7fc2811e7c2 in 92ms, sequenceid=6, compaction requested=false 2023-07-24 12:28:58,596 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-24 12:28:58,596 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f073fac22553ddc64db3e7fc2811e7c2: 2023-07-24 12:28:58,597 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,597 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 12:28:58,597 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion/f073fac22553ddc64db3e7fc2811e7c2/cf/a23d25784bcc43c7ada0a53db7a55301] hfiles 2023-07-24 12:28:58,597 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion/f073fac22553ddc64db3e7fc2811e7c2/cf/a23d25784bcc43c7ada0a53db7a55301 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,614 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2. completed. 2023-07-24 12:28:58,614 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2. 2023-07-24 12:28:58,614 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 12:28:58,614 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 12:28:58,614 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:58,614 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 12:28:58,614 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase6.apache.org,36595,1690201659396' in zk 2023-07-24 12:28:58,620 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:58,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:58,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:58,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:58,620 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 12:28:58,620 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:28:58,620 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 12:28:58,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:58,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:58,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:58,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:58,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:58,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:58,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:58,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:58,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase6.apache.org,36595,1690201659396': 2023-07-24 12:28:58,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,36595,1690201659396' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-24 12:28:58,676 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:28:58,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 12:28:58,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:28:58,677 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 12:28:58,964 INFO [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230724cc53883f2b334309a54fe616d823076a to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230724cc53883f2b334309a54fe616d823076a 2023-07-24 12:28:58,976 INFO [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion/90ebd46f45b7225dbe4c67ee88719c37/.tmp/cf/7127a15e2e094f19b3458d219b691346 2023-07-24 12:28:58,977 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:28:58,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 12:28:58,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:28:58,979 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 12:28:58,987 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion/90ebd46f45b7225dbe4c67ee88719c37/.tmp/cf/7127a15e2e094f19b3458d219b691346 as hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion/90ebd46f45b7225dbe4c67ee88719c37/cf/7127a15e2e094f19b3458d219b691346 2023-07-24 12:28:58,993 INFO [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion/90ebd46f45b7225dbe4c67ee88719c37/cf/7127a15e2e094f19b3458d219b691346, entries=45, sequenceid=6, filesize=13.2 K 2023-07-24 12:28:58,994 INFO [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 90ebd46f45b7225dbe4c67ee88719c37 in 498ms, sequenceid=6, compaction requested=false 2023-07-24 12:28:58,996 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 90ebd46f45b7225dbe4c67ee88719c37: 2023-07-24 12:28:58,996 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:58,996 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 12:28:58,996 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion/90ebd46f45b7225dbe4c67ee88719c37/cf/7127a15e2e094f19b3458d219b691346] hfiles 2023-07-24 12:28:58,996 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion/90ebd46f45b7225dbe4c67ee88719c37/cf/7127a15e2e094f19b3458d219b691346 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,409 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37. completed. 2023-07-24 12:28:59,409 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37. 2023-07-24 12:28:59,409 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 12:28:59,410 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 12:28:59,410 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:59,410 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 12:28:59,410 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase6.apache.org,44517,1690201659253' in zk 2023-07-24 12:28:59,412 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 12:28:59,412 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:28:59,413 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 12:28:59,414 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:59,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:59,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:59,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:59,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:59,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:59,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:59,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:59,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:59,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:59,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:59,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:59,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:59,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase6.apache.org,44517,1690201659253': 2023-07-24 12:28:59,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,44517,1690201659253' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-24 12:28:59,424 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-24 12:28:59,424 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 12:28:59,424 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 12:28:59,424 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,424 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 12:28:59,430 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,430 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,430 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,431 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:59,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,430 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:59,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:28:59,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:28:59,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,431 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,431 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:59,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,431 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:59,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:59,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:59,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:59,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:59,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:59,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:59,432 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:59,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,433 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:59,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:28:59,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:28:59,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,436 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:59,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:59,436 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:59,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:59,437 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:59,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:59,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:28:59,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:59,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:59,442 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:59,442 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,442 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:59,442 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:59,442 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:59,442 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:59,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:59,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:59,442 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:59,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:59,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:59,443 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:28:59,443 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,445 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,445 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 12:28:59,442 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,442 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:59,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:59,442 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:28:59,445 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:28:59,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:59,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:59,445 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:28:59,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:28:59,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:28:59,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:59,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:59,446 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230724cc53883f2b334309a54fe616d823076a, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307249efbc8f507044a698b7cdceb6511e85c] mob files 2023-07-24 12:28:59,446 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:28:59,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230724cc53883f2b334309a54fe616d823076a 2023-07-24 12:28:59,446 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:28:59,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307249efbc8f507044a698b7cdceb6511e85c 2023-07-24 12:28:59,446 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,447 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:28:59,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:28:59,447 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-24 12:28:59,474 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,475 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:28:59,479 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:28:59,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 12:28:59,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:28:59,481 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-24 12:28:59,535 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:29:00,001 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-24 12:29:00,001 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:29:00,002 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:29:00,002 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690201738366Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1690201739474 (+1108 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690201739474Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1690201739474Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1690201739489 (+15 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690201739519 (+30 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690201740001 (+482 ms) 2023-07-24 12:29:00,006 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 12:29:00,009 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 1.6380 sec 2023-07-24 12:29:00,481 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:29:00,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 12:29:00,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 12:29:00,520 DEBUG [Listener at jenkins-hbase6.apache.org/41373] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 12:29:00,544 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:53262, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 12:29:00,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36595] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 12:29:00,548 DEBUG [Listener at jenkins-hbase6.apache.org/41373] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 12:29:00,558 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:57276, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 12:29:00,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44275] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 12:29:00,559 DEBUG [Listener at jenkins-hbase6.apache.org/41373] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 12:29:00,561 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:56566, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 12:29:00,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44517] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 12:29:00,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.HMaster$4(2112): Client=jenkins//172.31.2.20 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 12:29:00,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:00,569 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 12:29:00,569 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(700): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-24 12:29:00,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 12:29:00,573 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 12:29:00,576 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7dfd521331568211368aff4d73fad3b 2023-07-24 12:29:00,579 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7dfd521331568211368aff4d73fad3b empty. 2023-07-24 12:29:00,579 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d87a8d2a6de29c85434072ea417969b 2023-07-24 12:29:00,580 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7dfd521331568211368aff4d73fad3b 2023-07-24 12:29:00,580 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d87a8d2a6de29c85434072ea417969b empty. 2023-07-24 12:29:00,581 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d87a8d2a6de29c85434072ea417969b 2023-07-24 12:29:00,581 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-24 12:29:00,607 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-24 12:29:00,613 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => b7dfd521331568211368aff4d73fad3b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740564.b7dfd521331568211368aff4d73fad3b.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp 2023-07-24 12:29:00,616 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0d87a8d2a6de29c85434072ea417969b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690201740564.0d87a8d2a6de29c85434072ea417969b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp 2023-07-24 12:29:00,643 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740564.b7dfd521331568211368aff4d73fad3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:29:00,644 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing b7dfd521331568211368aff4d73fad3b, disabling compactions & flushes 2023-07-24 12:29:00,644 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740564.b7dfd521331568211368aff4d73fad3b. 2023-07-24 12:29:00,644 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740564.b7dfd521331568211368aff4d73fad3b. 2023-07-24 12:29:00,644 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740564.b7dfd521331568211368aff4d73fad3b. after waiting 0 ms 2023-07-24 12:29:00,644 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740564.b7dfd521331568211368aff4d73fad3b. 2023-07-24 12:29:00,644 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740564.b7dfd521331568211368aff4d73fad3b. 2023-07-24 12:29:00,644 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for b7dfd521331568211368aff4d73fad3b: 2023-07-24 12:29:00,645 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690201740564.0d87a8d2a6de29c85434072ea417969b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:29:00,645 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 0d87a8d2a6de29c85434072ea417969b, disabling compactions & flushes 2023-07-24 12:29:00,645 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690201740564.0d87a8d2a6de29c85434072ea417969b. 2023-07-24 12:29:00,645 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690201740564.0d87a8d2a6de29c85434072ea417969b. 2023-07-24 12:29:00,645 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690201740564.0d87a8d2a6de29c85434072ea417969b. after waiting 0 ms 2023-07-24 12:29:00,645 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690201740564.0d87a8d2a6de29c85434072ea417969b. 2023-07-24 12:29:00,645 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690201740564.0d87a8d2a6de29c85434072ea417969b. 2023-07-24 12:29:00,645 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 0d87a8d2a6de29c85434072ea417969b: 2023-07-24 12:29:00,649 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 12:29:00,651 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740564.b7dfd521331568211368aff4d73fad3b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690201740650"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201740650"}]},"ts":"1690201740650"} 2023-07-24 12:29:00,651 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690201740564.0d87a8d2a6de29c85434072ea417969b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690201740650"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201740650"}]},"ts":"1690201740650"} 2023-07-24 12:29:00,654 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 12:29:00,655 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 12:29:00,656 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201740656"}]},"ts":"1690201740656"} 2023-07-24 12:29:00,657 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-24 12:29:00,661 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-07-24 12:29:00,663 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 12:29:00,663 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 12:29:00,663 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 12:29:00,663 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 12:29:00,663 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b7dfd521331568211368aff4d73fad3b, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0d87a8d2a6de29c85434072ea417969b, ASSIGN}] 2023-07-24 12:29:00,666 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0d87a8d2a6de29c85434072ea417969b, ASSIGN 2023-07-24 12:29:00,666 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b7dfd521331568211368aff4d73fad3b, ASSIGN 2023-07-24 12:29:00,668 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b7dfd521331568211368aff4d73fad3b, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,44517,1690201659253; forceNewPlan=false, retain=false 2023-07-24 12:29:00,668 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0d87a8d2a6de29c85434072ea417969b, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,36595,1690201659396; forceNewPlan=false, retain=false 2023-07-24 12:29:00,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 12:29:00,818 INFO [jenkins-hbase6:38215] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 12:29:00,822 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=0d87a8d2a6de29c85434072ea417969b, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:00,822 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=b7dfd521331568211368aff4d73fad3b, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:00,822 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690201740564.0d87a8d2a6de29c85434072ea417969b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690201740822"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201740822"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201740822"}]},"ts":"1690201740822"} 2023-07-24 12:29:00,822 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740564.b7dfd521331568211368aff4d73fad3b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690201740822"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201740822"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201740822"}]},"ts":"1690201740822"} 2023-07-24 12:29:00,829 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 0d87a8d2a6de29c85434072ea417969b, server=jenkins-hbase6.apache.org,36595,1690201659396}] 2023-07-24 12:29:00,835 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure b7dfd521331568211368aff4d73fad3b, server=jenkins-hbase6.apache.org,44517,1690201659253}] 2023-07-24 12:29:00,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 12:29:00,987 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1690201740564.0d87a8d2a6de29c85434072ea417969b. 2023-07-24 12:29:00,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0d87a8d2a6de29c85434072ea417969b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690201740564.0d87a8d2a6de29c85434072ea417969b.', STARTKEY => '2', ENDKEY => ''} 2023-07-24 12:29:00,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1690201740564.0d87a8d2a6de29c85434072ea417969b. service=AccessControlService 2023-07-24 12:29:00,989 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 12:29:00,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 0d87a8d2a6de29c85434072ea417969b 2023-07-24 12:29:00,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690201740564.0d87a8d2a6de29c85434072ea417969b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:29:00,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 0d87a8d2a6de29c85434072ea417969b 2023-07-24 12:29:00,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 0d87a8d2a6de29c85434072ea417969b 2023-07-24 12:29:00,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740564.b7dfd521331568211368aff4d73fad3b. 2023-07-24 12:29:00,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b7dfd521331568211368aff4d73fad3b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740564.b7dfd521331568211368aff4d73fad3b.', STARTKEY => '', ENDKEY => '2'} 2023-07-24 12:29:00,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740564.b7dfd521331568211368aff4d73fad3b. service=AccessControlService 2023-07-24 12:29:00,990 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 12:29:00,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 b7dfd521331568211368aff4d73fad3b 2023-07-24 12:29:00,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740564.b7dfd521331568211368aff4d73fad3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:29:00,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for b7dfd521331568211368aff4d73fad3b 2023-07-24 12:29:00,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for b7dfd521331568211368aff4d73fad3b 2023-07-24 12:29:00,991 INFO [StoreOpener-0d87a8d2a6de29c85434072ea417969b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0d87a8d2a6de29c85434072ea417969b 2023-07-24 12:29:00,993 DEBUG [StoreOpener-0d87a8d2a6de29c85434072ea417969b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d87a8d2a6de29c85434072ea417969b/cf 2023-07-24 12:29:00,993 DEBUG [StoreOpener-0d87a8d2a6de29c85434072ea417969b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d87a8d2a6de29c85434072ea417969b/cf 2023-07-24 12:29:00,994 INFO [StoreOpener-0d87a8d2a6de29c85434072ea417969b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0d87a8d2a6de29c85434072ea417969b columnFamilyName cf 2023-07-24 12:29:00,994 INFO [StoreOpener-0d87a8d2a6de29c85434072ea417969b-1] regionserver.HStore(310): Store=0d87a8d2a6de29c85434072ea417969b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 12:29:01,000 INFO [StoreOpener-b7dfd521331568211368aff4d73fad3b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b7dfd521331568211368aff4d73fad3b 2023-07-24 12:29:01,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d87a8d2a6de29c85434072ea417969b 2023-07-24 12:29:01,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d87a8d2a6de29c85434072ea417969b 2023-07-24 12:29:01,001 DEBUG [StoreOpener-b7dfd521331568211368aff4d73fad3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7dfd521331568211368aff4d73fad3b/cf 2023-07-24 12:29:01,001 DEBUG [StoreOpener-b7dfd521331568211368aff4d73fad3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7dfd521331568211368aff4d73fad3b/cf 2023-07-24 12:29:01,002 INFO [StoreOpener-b7dfd521331568211368aff4d73fad3b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b7dfd521331568211368aff4d73fad3b columnFamilyName cf 2023-07-24 12:29:01,003 INFO [StoreOpener-b7dfd521331568211368aff4d73fad3b-1] regionserver.HStore(310): Store=b7dfd521331568211368aff4d73fad3b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 12:29:01,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7dfd521331568211368aff4d73fad3b 2023-07-24 12:29:01,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 0d87a8d2a6de29c85434072ea417969b 2023-07-24 12:29:01,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7dfd521331568211368aff4d73fad3b 2023-07-24 12:29:01,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d87a8d2a6de29c85434072ea417969b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 12:29:01,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 0d87a8d2a6de29c85434072ea417969b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72381625, jitterRate=0.07857026159763336}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 12:29:01,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 0d87a8d2a6de29c85434072ea417969b: 2023-07-24 12:29:01,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for b7dfd521331568211368aff4d73fad3b 2023-07-24 12:29:01,009 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690201740564.0d87a8d2a6de29c85434072ea417969b., pid=69, masterSystemTime=1690201740984 2023-07-24 12:29:01,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690201740564.0d87a8d2a6de29c85434072ea417969b. 2023-07-24 12:29:01,012 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1690201740564.0d87a8d2a6de29c85434072ea417969b. 2023-07-24 12:29:01,012 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=0d87a8d2a6de29c85434072ea417969b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:01,012 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690201740564.0d87a8d2a6de29c85434072ea417969b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690201741011"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690201741011"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690201741011"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690201741011"}]},"ts":"1690201741011"} 2023-07-24 12:29:01,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7dfd521331568211368aff4d73fad3b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 12:29:01,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened b7dfd521331568211368aff4d73fad3b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69089455, jitterRate=0.029513105750083923}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 12:29:01,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for b7dfd521331568211368aff4d73fad3b: 2023-07-24 12:29:01,016 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-24 12:29:01,016 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 0d87a8d2a6de29c85434072ea417969b, server=jenkins-hbase6.apache.org,36595,1690201659396 in 184 msec 2023-07-24 12:29:01,016 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740564.b7dfd521331568211368aff4d73fad3b., pid=70, masterSystemTime=1690201740987 2023-07-24 12:29:01,021 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0d87a8d2a6de29c85434072ea417969b, ASSIGN in 353 msec 2023-07-24 12:29:01,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740564.b7dfd521331568211368aff4d73fad3b. 2023-07-24 12:29:01,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740564.b7dfd521331568211368aff4d73fad3b. 2023-07-24 12:29:01,022 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=b7dfd521331568211368aff4d73fad3b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:01,022 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740564.b7dfd521331568211368aff4d73fad3b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690201741022"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690201741022"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690201741022"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690201741022"}]},"ts":"1690201741022"} 2023-07-24 12:29:01,032 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-24 12:29:01,032 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure b7dfd521331568211368aff4d73fad3b, server=jenkins-hbase6.apache.org,44517,1690201659253 in 193 msec 2023-07-24 12:29:01,034 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-24 12:29:01,034 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b7dfd521331568211368aff4d73fad3b, ASSIGN in 369 msec 2023-07-24 12:29:01,035 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 12:29:01,035 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201741035"}]},"ts":"1690201741035"} 2023-07-24 12:29:01,039 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-24 12:29:01,042 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 12:29:01,042 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-24 12:29:01,044 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36595] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-24 12:29:01,046 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:01,046 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:01,046 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:01,046 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:01,048 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 12:29:01,048 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 12:29:01,048 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 12:29:01,049 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 12:29:01,049 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 12:29:01,049 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 12:29:01,049 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 12:29:01,049 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 12:29:01,050 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 484 msec 2023-07-24 12:29:01,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 12:29:01,174 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-24 12:29:01,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.HMaster$2(1952): Client=jenkins//172.31.2.20 merge regions b7dfd521331568211368aff4d73fad3b, 0d87a8d2a6de29c85434072ea417969b 2023-07-24 12:29:01,243 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0004_000001 (auth:SIMPLE) 2023-07-24 12:29:01,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b7dfd521331568211368aff4d73fad3b, 0d87a8d2a6de29c85434072ea417969b], force=true 2023-07-24 12:29:01,254 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b7dfd521331568211368aff4d73fad3b, 0d87a8d2a6de29c85434072ea417969b], force=true 2023-07-24 12:29:01,254 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b7dfd521331568211368aff4d73fad3b, 0d87a8d2a6de29c85434072ea417969b], force=true 2023-07-24 12:29:01,254 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b7dfd521331568211368aff4d73fad3b, 0d87a8d2a6de29c85434072ea417969b], force=true 2023-07-24 12:29:01,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 12:29:01,285 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b7dfd521331568211368aff4d73fad3b, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0d87a8d2a6de29c85434072ea417969b, UNASSIGN}] 2023-07-24 12:29:01,287 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b7dfd521331568211368aff4d73fad3b, UNASSIGN 2023-07-24 12:29:01,287 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0d87a8d2a6de29c85434072ea417969b, UNASSIGN 2023-07-24 12:29:01,288 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=b7dfd521331568211368aff4d73fad3b, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:01,288 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=0d87a8d2a6de29c85434072ea417969b, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:01,288 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740564.b7dfd521331568211368aff4d73fad3b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690201741288"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201741288"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201741288"}]},"ts":"1690201741288"} 2023-07-24 12:29:01,288 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690201740564.0d87a8d2a6de29c85434072ea417969b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690201741288"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201741288"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201741288"}]},"ts":"1690201741288"} 2023-07-24 12:29:01,291 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure b7dfd521331568211368aff4d73fad3b, server=jenkins-hbase6.apache.org,44517,1690201659253}] 2023-07-24 12:29:01,293 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 0d87a8d2a6de29c85434072ea417969b, server=jenkins-hbase6.apache.org,36595,1690201659396}] 2023-07-24 12:29:01,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 12:29:01,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(111): Close 0d87a8d2a6de29c85434072ea417969b 2023-07-24 12:29:01,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(111): Close b7dfd521331568211368aff4d73fad3b 2023-07-24 12:29:01,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 0d87a8d2a6de29c85434072ea417969b, disabling compactions & flushes 2023-07-24 12:29:01,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing b7dfd521331568211368aff4d73fad3b, disabling compactions & flushes 2023-07-24 12:29:01,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690201740564.0d87a8d2a6de29c85434072ea417969b. 2023-07-24 12:29:01,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740564.b7dfd521331568211368aff4d73fad3b. 2023-07-24 12:29:01,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690201740564.0d87a8d2a6de29c85434072ea417969b. 2023-07-24 12:29:01,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740564.b7dfd521331568211368aff4d73fad3b. 2023-07-24 12:29:01,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690201740564.0d87a8d2a6de29c85434072ea417969b. after waiting 0 ms 2023-07-24 12:29:01,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740564.b7dfd521331568211368aff4d73fad3b. after waiting 0 ms 2023-07-24 12:29:01,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740564.b7dfd521331568211368aff4d73fad3b. 2023-07-24 12:29:01,449 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690201740564.0d87a8d2a6de29c85434072ea417969b. 2023-07-24 12:29:01,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2745): Flushing b7dfd521331568211368aff4d73fad3b 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-24 12:29:01,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2745): Flushing 0d87a8d2a6de29c85434072ea417969b 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-24 12:29:01,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d87a8d2a6de29c85434072ea417969b/.tmp/cf/05e75a60fd944e3fbccc8ba92debdbb5 2023-07-24 12:29:01,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d87a8d2a6de29c85434072ea417969b/.tmp/cf/05e75a60fd944e3fbccc8ba92debdbb5 as hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d87a8d2a6de29c85434072ea417969b/cf/05e75a60fd944e3fbccc8ba92debdbb5 2023-07-24 12:29:01,491 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d87a8d2a6de29c85434072ea417969b/cf/05e75a60fd944e3fbccc8ba92debdbb5, entries=1, sequenceid=5, filesize=4.7 K 2023-07-24 12:29:01,492 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 0d87a8d2a6de29c85434072ea417969b in 43ms, sequenceid=5, compaction requested=false 2023-07-24 12:29:01,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-24 12:29:01,518 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7dfd521331568211368aff4d73fad3b/.tmp/cf/a1bdf61274fb44bfa3c0e42a3619881c 2023-07-24 12:29:01,532 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d87a8d2a6de29c85434072ea417969b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-24 12:29:01,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7dfd521331568211368aff4d73fad3b/.tmp/cf/a1bdf61274fb44bfa3c0e42a3619881c as hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7dfd521331568211368aff4d73fad3b/cf/a1bdf61274fb44bfa3c0e42a3619881c 2023-07-24 12:29:01,533 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 12:29:01,536 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690201740564.0d87a8d2a6de29c85434072ea417969b. 2023-07-24 12:29:01,536 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 0d87a8d2a6de29c85434072ea417969b: 2023-07-24 12:29:01,541 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(149): Closed 0d87a8d2a6de29c85434072ea417969b 2023-07-24 12:29:01,541 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=0d87a8d2a6de29c85434072ea417969b, regionState=CLOSED 2023-07-24 12:29:01,542 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690201740564.0d87a8d2a6de29c85434072ea417969b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690201741541"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201741541"}]},"ts":"1690201741541"} 2023-07-24 12:29:01,548 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-24 12:29:01,548 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 0d87a8d2a6de29c85434072ea417969b, server=jenkins-hbase6.apache.org,36595,1690201659396 in 251 msec 2023-07-24 12:29:01,549 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7dfd521331568211368aff4d73fad3b/cf/a1bdf61274fb44bfa3c0e42a3619881c, entries=1, sequenceid=5, filesize=4.7 K 2023-07-24 12:29:01,550 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=0d87a8d2a6de29c85434072ea417969b, UNASSIGN in 264 msec 2023-07-24 12:29:01,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for b7dfd521331568211368aff4d73fad3b in 101ms, sequenceid=5, compaction requested=false 2023-07-24 12:29:01,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 12:29:01,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7dfd521331568211368aff4d73fad3b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-24 12:29:01,576 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 12:29:01,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740564.b7dfd521331568211368aff4d73fad3b. 2023-07-24 12:29:01,578 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for b7dfd521331568211368aff4d73fad3b: 2023-07-24 12:29:01,582 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(149): Closed b7dfd521331568211368aff4d73fad3b 2023-07-24 12:29:01,582 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=b7dfd521331568211368aff4d73fad3b, regionState=CLOSED 2023-07-24 12:29:01,582 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740564.b7dfd521331568211368aff4d73fad3b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690201741582"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201741582"}]},"ts":"1690201741582"} 2023-07-24 12:29:01,587 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-24 12:29:01,587 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure b7dfd521331568211368aff4d73fad3b, server=jenkins-hbase6.apache.org,44517,1690201659253 in 295 msec 2023-07-24 12:29:01,589 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-24 12:29:01,589 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b7dfd521331568211368aff4d73fad3b, UNASSIGN in 307 msec 2023-07-24 12:29:01,762 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a21fd6d8176d94e89420348dc41f3a3b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-24 12:29:01,765 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740564.b7dfd521331568211368aff4d73fad3b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 12:29:01,766 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690201740564.0d87a8d2a6de29c85434072ea417969b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 12:29:01,766 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740565.a21fd6d8176d94e89420348dc41f3a3b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 12:29:01,839 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a21fd6d8176d94e89420348dc41f3a3b, ASSIGN}] 2023-07-24 12:29:01,840 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a21fd6d8176d94e89420348dc41f3a3b, ASSIGN 2023-07-24 12:29:01,841 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a21fd6d8176d94e89420348dc41f3a3b, ASSIGN; state=MERGED, location=jenkins-hbase6.apache.org,44517,1690201659253; forceNewPlan=false, retain=false 2023-07-24 12:29:01,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 12:29:01,992 INFO [jenkins-hbase6:38215] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 12:29:01,994 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=a21fd6d8176d94e89420348dc41f3a3b, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:01,994 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740565.a21fd6d8176d94e89420348dc41f3a3b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690201741994"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201741994"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201741994"}]},"ts":"1690201741994"} 2023-07-24 12:29:01,996 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure a21fd6d8176d94e89420348dc41f3a3b, server=jenkins-hbase6.apache.org,44517,1690201659253}] 2023-07-24 12:29:02,043 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 12:29:02,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740565.a21fd6d8176d94e89420348dc41f3a3b. 2023-07-24 12:29:02,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a21fd6d8176d94e89420348dc41f3a3b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740565.a21fd6d8176d94e89420348dc41f3a3b.', STARTKEY => '', ENDKEY => ''} 2023-07-24 12:29:02,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740565.a21fd6d8176d94e89420348dc41f3a3b. service=AccessControlService 2023-07-24 12:29:02,154 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 12:29:02,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 a21fd6d8176d94e89420348dc41f3a3b 2023-07-24 12:29:02,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740565.a21fd6d8176d94e89420348dc41f3a3b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:29:02,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for a21fd6d8176d94e89420348dc41f3a3b 2023-07-24 12:29:02,154 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for a21fd6d8176d94e89420348dc41f3a3b 2023-07-24 12:29:02,156 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a21fd6d8176d94e89420348dc41f3a3b/.regioninfo 2023-07-24 12:29:02,197 INFO [StoreOpener-a21fd6d8176d94e89420348dc41f3a3b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a21fd6d8176d94e89420348dc41f3a3b 2023-07-24 12:29:02,198 DEBUG [StoreOpener-a21fd6d8176d94e89420348dc41f3a3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a21fd6d8176d94e89420348dc41f3a3b/cf 2023-07-24 12:29:02,198 DEBUG [StoreOpener-a21fd6d8176d94e89420348dc41f3a3b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a21fd6d8176d94e89420348dc41f3a3b/cf 2023-07-24 12:29:02,199 INFO [StoreOpener-a21fd6d8176d94e89420348dc41f3a3b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a21fd6d8176d94e89420348dc41f3a3b columnFamilyName cf 2023-07-24 12:29:02,238 DEBUG [StoreOpener-a21fd6d8176d94e89420348dc41f3a3b-1] regionserver.HStore(539): loaded hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a21fd6d8176d94e89420348dc41f3a3b/cf/05e75a60fd944e3fbccc8ba92debdbb5.0d87a8d2a6de29c85434072ea417969b->hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d87a8d2a6de29c85434072ea417969b/cf/05e75a60fd944e3fbccc8ba92debdbb5-top 2023-07-24 12:29:02,268 DEBUG [StoreOpener-a21fd6d8176d94e89420348dc41f3a3b-1] regionserver.HStore(539): loaded hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a21fd6d8176d94e89420348dc41f3a3b/cf/a1bdf61274fb44bfa3c0e42a3619881c.b7dfd521331568211368aff4d73fad3b->hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7dfd521331568211368aff4d73fad3b/cf/a1bdf61274fb44bfa3c0e42a3619881c-top 2023-07-24 12:29:02,269 INFO [StoreOpener-a21fd6d8176d94e89420348dc41f3a3b-1] regionserver.HStore(310): Store=a21fd6d8176d94e89420348dc41f3a3b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 12:29:02,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a21fd6d8176d94e89420348dc41f3a3b 2023-07-24 12:29:02,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a21fd6d8176d94e89420348dc41f3a3b 2023-07-24 12:29:02,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for a21fd6d8176d94e89420348dc41f3a3b 2023-07-24 12:29:02,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened a21fd6d8176d94e89420348dc41f3a3b; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63440033, jitterRate=-0.05466984212398529}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 12:29:02,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for a21fd6d8176d94e89420348dc41f3a3b: 2023-07-24 12:29:02,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740565.a21fd6d8176d94e89420348dc41f3a3b., pid=77, masterSystemTime=1690201742149 2023-07-24 12:29:02,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740565.a21fd6d8176d94e89420348dc41f3a3b.,because compaction is disabled. 2023-07-24 12:29:02,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740565.a21fd6d8176d94e89420348dc41f3a3b. 2023-07-24 12:29:02,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740565.a21fd6d8176d94e89420348dc41f3a3b. 2023-07-24 12:29:02,292 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=a21fd6d8176d94e89420348dc41f3a3b, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:02,293 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740565.a21fd6d8176d94e89420348dc41f3a3b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690201742292"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690201742292"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690201742292"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690201742292"}]},"ts":"1690201742292"} 2023-07-24 12:29:02,297 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-24 12:29:02,297 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure a21fd6d8176d94e89420348dc41f3a3b, server=jenkins-hbase6.apache.org,44517,1690201659253 in 299 msec 2023-07-24 12:29:02,299 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-24 12:29:02,299 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a21fd6d8176d94e89420348dc41f3a3b, ASSIGN in 458 msec 2023-07-24 12:29:02,301 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b7dfd521331568211368aff4d73fad3b, 0d87a8d2a6de29c85434072ea417969b], force=true in 1.0570 sec 2023-07-24 12:29:02,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 12:29:02,367 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-24 12:29:02,367 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1583): Client=jenkins//172.31.2.20 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 12:29:02,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690201742367 (current time:1690201742367). 2023-07-24 12:29:02,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 12:29:02,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(139): Connect 0x144832ec to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:29:02,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@651e9e9a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:29:02,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:29:02,379 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:56580, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:29:02,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x144832ec to 127.0.0.1:49553 2023-07-24 12:29:02,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:29:02,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(139): Connect 0x0b5070fa to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:29:02,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e5afc2e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:29:02,389 DEBUG [hconnection-0x4fa14331-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:29:02,392 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:56596, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:29:02,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:29:02,399 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:53278, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:29:02,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0b5070fa to 127.0.0.1:49553 2023-07-24 12:29:02,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:29:02,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-24 12:29:02,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 12:29:02,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 12:29:02,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 12:29:02,405 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 12:29:02,405 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1690202342405 2023-07-24 12:29:02,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 12:29:02,406 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,410 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 12:29:02,410 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 12:29:02,410 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 12:29:02,411 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 12:29:02,413 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 9 msec 2023-07-24 12:29:02,414 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 12:29:02,414 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1690202342414 2023-07-24 12:29:02,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,425 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-24 12:29:02,425 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:29:02,427 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-24 12:29:02,427 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-24 12:29:02,427 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,427 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,428 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:02,428 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:02,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:02,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:02,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:02,429 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:02,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:02,429 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:02,429 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:02,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:02,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,430 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:02,430 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 12:29:02,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 12:29:02,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 12:29:02,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 12:29:02,430 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 12:29:02,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,430 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 12:29:02,431 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 12:29:02,431 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,431 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 12:29:02,431 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:29:02,431 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,435 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,435 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 12:29:02,435 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 12:29:02,435 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:29:02,435 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 12:29:02,436 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 12:29:02,436 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 12:29:02,435 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:29:02,437 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 12:29:02,437 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 12:29:02,437 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 12:29:02,436 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44275,1690201659331' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 12:29:02,437 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44517,1690201659253' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 12:29:02,437 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,36595,1690201659396' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 12:29:02,440 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,442 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:02,442 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:02,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:29:02,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:29:02,442 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,442 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,442 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:29:02,443 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:29:02,443 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,443 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:29:02,443 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:29:02,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:29:02,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:02,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:02,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:02,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:29:02,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,44517,1690201659253' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-24 12:29:02,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7821f1bf[Count = 0] remaining members to acquire global barrier 2023-07-24 12:29:02,445 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-24 12:29:02,445 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,446 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,446 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,446 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,446 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 12:29:02,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,446 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:02,447 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 12:29:02,447 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 12:29:02,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,447 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase6.apache.org,36595,1690201659396' in zk 2023-07-24 12:29:02,447 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 12:29:02,447 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 12:29:02,447 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 12:29:02,447 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase6.apache.org,44275,1690201659331' in zk 2023-07-24 12:29:02,447 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 12:29:02,447 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 12:29:02,447 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740565.a21fd6d8176d94e89420348dc41f3a3b. 2023-07-24 12:29:02,447 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740565.a21fd6d8176d94e89420348dc41f3a3b. started... 2023-07-24 12:29:02,448 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a21fd6d8176d94e89420348dc41f3a3b: 2023-07-24 12:29:02,449 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 12:29:02,449 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:29:02,449 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740565.a21fd6d8176d94e89420348dc41f3a3b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,449 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 12:29:02,450 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 12:29:02,450 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 12:29:02,450 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:29:02,450 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 12:29:02,450 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a21fd6d8176d94e89420348dc41f3a3b/cf/05e75a60fd944e3fbccc8ba92debdbb5.0d87a8d2a6de29c85434072ea417969b->hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d87a8d2a6de29c85434072ea417969b/cf/05e75a60fd944e3fbccc8ba92debdbb5-top, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a21fd6d8176d94e89420348dc41f3a3b/cf/a1bdf61274fb44bfa3c0e42a3619881c.b7dfd521331568211368aff4d73fad3b->hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7dfd521331568211368aff4d73fad3b/cf/a1bdf61274fb44bfa3c0e42a3619881c-top] hfiles 2023-07-24 12:29:02,453 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a21fd6d8176d94e89420348dc41f3a3b/cf/05e75a60fd944e3fbccc8ba92debdbb5.0d87a8d2a6de29c85434072ea417969b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,454 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a21fd6d8176d94e89420348dc41f3a3b/cf/a1bdf61274fb44bfa3c0e42a3619881c.b7dfd521331568211368aff4d73fad3b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,474 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740565.a21fd6d8176d94e89420348dc41f3a3b. completed. 2023-07-24 12:29:02,474 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740565.a21fd6d8176d94e89420348dc41f3a3b. 2023-07-24 12:29:02,474 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 12:29:02,474 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 12:29:02,474 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:02,474 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 12:29:02,474 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase6.apache.org,44517,1690201659253' in zk 2023-07-24 12:29:02,489 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:02,489 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 12:29:02,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:02,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:29:02,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:29:02,489 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:29:02,489 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 12:29:02,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:29:02,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:29:02,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:02,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:02,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:02,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:29:02,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:02,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:02,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:02,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase6.apache.org,44517,1690201659253': 2023-07-24 12:29:02,494 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,44517,1690201659253' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-24 12:29:02,495 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-24 12:29:02,495 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 12:29:02,495 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 12:29:02,495 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,495 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 12:29:02,497 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,497 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:29:02,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:29:02,497 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:02,497 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,497 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,497 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:02,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,498 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:02,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,497 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:02,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:29:02,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:02,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:02,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:02,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:02,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:02,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:02,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,499 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:02,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,499 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:02,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:29:02,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:02,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:02,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:02,501 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:02,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:29:02,502 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:02,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,502 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:02,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:02,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:02,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:02,505 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:02,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:02,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:02,505 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:02,506 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,506 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:02,506 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:29:02,505 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:02,506 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:02,505 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:02,506 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:02,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:02,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:02,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:02,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:02,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:02,506 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,506 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:02,506 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:02,507 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:02,507 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:02,508 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,508 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:02,508 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:02,508 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,508 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:02,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:02,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:02,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:02,508 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,515 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:29:02,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 12:29:02,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:29:02,537 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 12:29:02,600 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,639 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-24 12:29:02,639 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,639 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,639 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1690201742406Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690201742507 (+101 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690201742507Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690201742549 (+42 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690201742592 (+43 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1690201742639 (+47 ms) 2023-07-24 12:29:02,642 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 12:29:02,655 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 233 msec 2023-07-24 12:29:02,737 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:29:02,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 12:29:02,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 12:29:02,740 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201742739 2023-07-24 12:29:02,740 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42387, tgtDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201742739, rawTgtDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201742739, srcFsUri=hdfs://localhost:42387, srcDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa 2023-07-24 12:29:02,777 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42387, inputRoot=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa 2023-07-24 12:29:02,777 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1189667502_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201742739, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201742739/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,777 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42387, inputRoot=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa, snapshotDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-24 12:29:02,788 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201742739/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:02,866 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:02,867 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:02,867 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:02,868 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:02,868 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:02,869 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:02,869 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:02,974 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/hadoop-4881564681446086682.jar 2023-07-24 12:29:02,975 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:02,975 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:02,976 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:02,976 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:02,977 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:02,977 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:02,978 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 12:29:02,978 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 12:29:02,979 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 12:29:02,980 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 12:29:02,980 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 12:29:02,981 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 12:29:02,981 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 12:29:02,982 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 12:29:02,982 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 12:29:02,983 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 12:29:02,984 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:29:02,984 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:29:02,985 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 12:29:02,985 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:29:02,985 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:29:02,986 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 12:29:02,987 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 12:29:04,441 WARN [Listener at jenkins-hbase6.apache.org/41373] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 12:29:04,444 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-24 12:29:04,446 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-24 12:29:04,538 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 12:29:04,538 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 12:29:04,989 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0005_000001 (auth:SIMPLE) 2023-07-24 12:29:07,038 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 12:29:10,744 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0005_000001 (auth:SIMPLE) 2023-07-24 12:29:12,979 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0005_000001 (auth:SIMPLE) 2023-07-24 12:29:16,460 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0005_000001 (auth:SIMPLE) 2023-07-24 12:29:17,724 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 12:29:17,734 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 12:29:17,771 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:17,772 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 12:29:17,772 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 12:29:17,772 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1338397176_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:17,773 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-24 12:29:17,774 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-24 12:29:17,774 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1338397176_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201742739/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201742739/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:17,774 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201742739/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-24 12:29:17,774 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201742739/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-24 12:29:17,797 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:17,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.HMaster$11(2418): Client=jenkins//172.31.2.20 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:17,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:17,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 12:29:17,814 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201757813"}]},"ts":"1690201757813"} 2023-07-24 12:29:17,815 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-24 12:29:17,840 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-24 12:29:17,843 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a21fd6d8176d94e89420348dc41f3a3b, UNASSIGN}] 2023-07-24 12:29:17,845 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a21fd6d8176d94e89420348dc41f3a3b, UNASSIGN 2023-07-24 12:29:17,846 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=a21fd6d8176d94e89420348dc41f3a3b, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:17,846 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740565.a21fd6d8176d94e89420348dc41f3a3b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690201757846"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201757846"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201757846"}]},"ts":"1690201757846"} 2023-07-24 12:29:17,848 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure a21fd6d8176d94e89420348dc41f3a3b, server=jenkins-hbase6.apache.org,44517,1690201659253}] 2023-07-24 12:29:17,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 12:29:18,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(111): Close a21fd6d8176d94e89420348dc41f3a3b 2023-07-24 12:29:18,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing a21fd6d8176d94e89420348dc41f3a3b, disabling compactions & flushes 2023-07-24 12:29:18,000 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740565.a21fd6d8176d94e89420348dc41f3a3b. 2023-07-24 12:29:18,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740565.a21fd6d8176d94e89420348dc41f3a3b. 2023-07-24 12:29:18,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740565.a21fd6d8176d94e89420348dc41f3a3b. after waiting 0 ms 2023-07-24 12:29:18,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740565.a21fd6d8176d94e89420348dc41f3a3b. 2023-07-24 12:29:18,026 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a21fd6d8176d94e89420348dc41f3a3b/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-24 12:29:18,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 12:29:18,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740565.a21fd6d8176d94e89420348dc41f3a3b. 2023-07-24 12:29:18,029 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for a21fd6d8176d94e89420348dc41f3a3b: 2023-07-24 12:29:18,032 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(149): Closed a21fd6d8176d94e89420348dc41f3a3b 2023-07-24 12:29:18,032 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=a21fd6d8176d94e89420348dc41f3a3b, regionState=CLOSED 2023-07-24 12:29:18,032 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740565.a21fd6d8176d94e89420348dc41f3a3b.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690201758032"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201758032"}]},"ts":"1690201758032"} 2023-07-24 12:29:18,041 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-24 12:29:18,041 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure a21fd6d8176d94e89420348dc41f3a3b, server=jenkins-hbase6.apache.org,44517,1690201659253 in 191 msec 2023-07-24 12:29:18,043 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-24 12:29:18,043 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a21fd6d8176d94e89420348dc41f3a3b, UNASSIGN in 198 msec 2023-07-24 12:29:18,043 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201758043"}]},"ts":"1690201758043"} 2023-07-24 12:29:18,046 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-24 12:29:18,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 12:29:18,115 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-24 12:29:18,118 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 318 msec 2023-07-24 12:29:18,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 12:29:18,406 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-24 12:29:18,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.HMaster$5(2228): Client=jenkins//172.31.2.20 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:18,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:18,410 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:18,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:18,411 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:18,412 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36595] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:18,415 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d87a8d2a6de29c85434072ea417969b 2023-07-24 12:29:18,415 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a21fd6d8176d94e89420348dc41f3a3b 2023-07-24 12:29:18,415 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7dfd521331568211368aff4d73fad3b 2023-07-24 12:29:18,417 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d87a8d2a6de29c85434072ea417969b/cf, FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d87a8d2a6de29c85434072ea417969b/recovered.edits] 2023-07-24 12:29:18,417 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a21fd6d8176d94e89420348dc41f3a3b/cf, FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a21fd6d8176d94e89420348dc41f3a3b/recovered.edits] 2023-07-24 12:29:18,417 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7dfd521331568211368aff4d73fad3b/cf, FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7dfd521331568211368aff4d73fad3b/recovered.edits] 2023-07-24 12:29:18,421 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d87a8d2a6de29c85434072ea417969b/cf/05e75a60fd944e3fbccc8ba92debdbb5 to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d87a8d2a6de29c85434072ea417969b/cf/05e75a60fd944e3fbccc8ba92debdbb5 2023-07-24 12:29:18,421 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7dfd521331568211368aff4d73fad3b/cf/a1bdf61274fb44bfa3c0e42a3619881c to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7dfd521331568211368aff4d73fad3b/cf/a1bdf61274fb44bfa3c0e42a3619881c 2023-07-24 12:29:18,421 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a21fd6d8176d94e89420348dc41f3a3b/cf/05e75a60fd944e3fbccc8ba92debdbb5.0d87a8d2a6de29c85434072ea417969b to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a21fd6d8176d94e89420348dc41f3a3b/cf/05e75a60fd944e3fbccc8ba92debdbb5.0d87a8d2a6de29c85434072ea417969b 2023-07-24 12:29:18,424 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a21fd6d8176d94e89420348dc41f3a3b/cf/a1bdf61274fb44bfa3c0e42a3619881c.b7dfd521331568211368aff4d73fad3b to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a21fd6d8176d94e89420348dc41f3a3b/cf/a1bdf61274fb44bfa3c0e42a3619881c.b7dfd521331568211368aff4d73fad3b 2023-07-24 12:29:18,425 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d87a8d2a6de29c85434072ea417969b/recovered.edits/8.seqid to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d87a8d2a6de29c85434072ea417969b/recovered.edits/8.seqid 2023-07-24 12:29:18,426 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/0d87a8d2a6de29c85434072ea417969b 2023-07-24 12:29:18,426 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7dfd521331568211368aff4d73fad3b/recovered.edits/8.seqid to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7dfd521331568211368aff4d73fad3b/recovered.edits/8.seqid 2023-07-24 12:29:18,427 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b7dfd521331568211368aff4d73fad3b 2023-07-24 12:29:18,428 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a21fd6d8176d94e89420348dc41f3a3b/recovered.edits/12.seqid to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a21fd6d8176d94e89420348dc41f3a3b/recovered.edits/12.seqid 2023-07-24 12:29:18,429 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a21fd6d8176d94e89420348dc41f3a3b 2023-07-24 12:29:18,429 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-24 12:29:18,432 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:18,438 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-24 12:29:18,444 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-24 12:29:18,445 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:18,445 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-24 12:29:18,445 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740565.a21fd6d8176d94e89420348dc41f3a3b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690201758445"}]},"ts":"9223372036854775807"} 2023-07-24 12:29:18,450 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-24 12:29:18,450 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a21fd6d8176d94e89420348dc41f3a3b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690201740565.a21fd6d8176d94e89420348dc41f3a3b.', STARTKEY => '', ENDKEY => ''}] 2023-07-24 12:29:18,450 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-24 12:29:18,450 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690201758450"}]},"ts":"9223372036854775807"} 2023-07-24 12:29:18,454 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:18,454 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:18,454 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:18,454 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-24 12:29:18,455 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 12:29:18,455 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 12:29:18,455 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 12:29:18,459 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:18,508 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:18,510 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:18,510 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:18,510 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-24 12:29:18,510 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:18,510 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 12:29:18,510 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:18,510 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:18,510 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:18,510 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:18,511 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 102 msec 2023-07-24 12:29:18,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-24 12:29:18,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 12:29:18,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 12:29:18,512 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-24 12:29:18,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 12:29:18,512 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 12:29:18,512 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 12:29:18,513 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.HMaster$11(2418): Client=jenkins//172.31.2.20 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 12:29:18,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 12:29:18,519 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201758519"}]},"ts":"1690201758519"} 2023-07-24 12:29:18,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 12:29:18,521 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-24 12:29:18,540 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-24 12:29:18,559 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f073fac22553ddc64db3e7fc2811e7c2, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=90ebd46f45b7225dbe4c67ee88719c37, UNASSIGN}] 2023-07-24 12:29:18,562 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f073fac22553ddc64db3e7fc2811e7c2, UNASSIGN 2023-07-24 12:29:18,562 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=90ebd46f45b7225dbe4c67ee88719c37, UNASSIGN 2023-07-24 12:29:18,563 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=f073fac22553ddc64db3e7fc2811e7c2, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:18,563 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690201758563"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201758563"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201758563"}]},"ts":"1690201758563"} 2023-07-24 12:29:18,564 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=90ebd46f45b7225dbe4c67ee88719c37, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:18,564 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690201758564"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201758564"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201758564"}]},"ts":"1690201758564"} 2023-07-24 12:29:18,566 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure f073fac22553ddc64db3e7fc2811e7c2, server=jenkins-hbase6.apache.org,36595,1690201659396}] 2023-07-24 12:29:18,567 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 90ebd46f45b7225dbe4c67ee88719c37, server=jenkins-hbase6.apache.org,44517,1690201659253}] 2023-07-24 12:29:18,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 12:29:18,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(111): Close 90ebd46f45b7225dbe4c67ee88719c37 2023-07-24 12:29:18,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 90ebd46f45b7225dbe4c67ee88719c37, disabling compactions & flushes 2023-07-24 12:29:18,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37. 2023-07-24 12:29:18,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37. 2023-07-24 12:29:18,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37. after waiting 0 ms 2023-07-24 12:29:18,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37. 2023-07-24 12:29:18,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(111): Close f073fac22553ddc64db3e7fc2811e7c2 2023-07-24 12:29:18,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing f073fac22553ddc64db3e7fc2811e7c2, disabling compactions & flushes 2023-07-24 12:29:18,737 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2. 2023-07-24 12:29:18,737 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2. 2023-07-24 12:29:18,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2. after waiting 0 ms 2023-07-24 12:29:18,738 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2. 2023-07-24 12:29:18,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion/f073fac22553ddc64db3e7fc2811e7c2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 12:29:18,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 12:29:18,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithMergeRegion/90ebd46f45b7225dbe4c67ee88719c37/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 12:29:18,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 12:29:18,762 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2. 2023-07-24 12:29:18,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for f073fac22553ddc64db3e7fc2811e7c2: 2023-07-24 12:29:18,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37. 2023-07-24 12:29:18,763 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 90ebd46f45b7225dbe4c67ee88719c37: 2023-07-24 12:29:18,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(149): Closed 90ebd46f45b7225dbe4c67ee88719c37 2023-07-24 12:29:18,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(149): Closed f073fac22553ddc64db3e7fc2811e7c2 2023-07-24 12:29:18,770 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=f073fac22553ddc64db3e7fc2811e7c2, regionState=CLOSED 2023-07-24 12:29:18,770 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=90ebd46f45b7225dbe4c67ee88719c37, regionState=CLOSED 2023-07-24 12:29:18,770 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690201758770"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201758770"}]},"ts":"1690201758770"} 2023-07-24 12:29:18,770 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690201758770"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201758770"}]},"ts":"1690201758770"} 2023-07-24 12:29:18,776 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-24 12:29:18,776 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-24 12:29:18,776 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 90ebd46f45b7225dbe4c67ee88719c37, server=jenkins-hbase6.apache.org,44517,1690201659253 in 205 msec 2023-07-24 12:29:18,776 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure f073fac22553ddc64db3e7fc2811e7c2, server=jenkins-hbase6.apache.org,36595,1690201659396 in 206 msec 2023-07-24 12:29:18,797 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=90ebd46f45b7225dbe4c67ee88719c37, UNASSIGN in 217 msec 2023-07-24 12:29:18,798 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-24 12:29:18,798 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=f073fac22553ddc64db3e7fc2811e7c2, UNASSIGN in 217 msec 2023-07-24 12:29:18,799 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201758799"}]},"ts":"1690201758799"} 2023-07-24 12:29:18,802 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-24 12:29:18,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 12:29:18,840 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-24 12:29:18,844 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 329 msec 2023-07-24 12:29:19,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 12:29:19,125 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-24 12:29:19,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.HMaster$5(2228): Client=jenkins//172.31.2.20 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 12:29:19,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 12:29:19,129 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 12:29:19,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 12:29:19,130 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 12:29:19,131 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36595] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 12:29:19,134 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 12:29:19,134 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 12:29:19,134 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 12:29:19,134 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 12:29:19,134 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 12:29:19,135 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 12:29:19,135 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f073fac22553ddc64db3e7fc2811e7c2 2023-07-24 12:29:19,135 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/90ebd46f45b7225dbe4c67ee88719c37 2023-07-24 12:29:19,136 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:19,136 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:19,136 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-24 12:29:19,136 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 12:29:19,136 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:19,136 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-24 12:29:19,136 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 12:29:19,136 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 12:29:19,137 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f073fac22553ddc64db3e7fc2811e7c2/cf, FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f073fac22553ddc64db3e7fc2811e7c2/recovered.edits] 2023-07-24 12:29:19,138 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/90ebd46f45b7225dbe4c67ee88719c37/cf, FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/90ebd46f45b7225dbe4c67ee88719c37/recovered.edits] 2023-07-24 12:29:19,139 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 12:29:19,139 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:19,142 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f073fac22553ddc64db3e7fc2811e7c2/cf/a23d25784bcc43c7ada0a53db7a55301 to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f073fac22553ddc64db3e7fc2811e7c2/cf/a23d25784bcc43c7ada0a53db7a55301 2023-07-24 12:29:19,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-24 12:29:19,143 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/90ebd46f45b7225dbe4c67ee88719c37/cf/7127a15e2e094f19b3458d219b691346 to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/90ebd46f45b7225dbe4c67ee88719c37/cf/7127a15e2e094f19b3458d219b691346 2023-07-24 12:29:19,146 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f073fac22553ddc64db3e7fc2811e7c2/recovered.edits/9.seqid to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/f073fac22553ddc64db3e7fc2811e7c2/recovered.edits/9.seqid 2023-07-24 12:29:19,147 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/f073fac22553ddc64db3e7fc2811e7c2 2023-07-24 12:29:19,147 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/90ebd46f45b7225dbe4c67ee88719c37/recovered.edits/9.seqid to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/90ebd46f45b7225dbe4c67ee88719c37/recovered.edits/9.seqid 2023-07-24 12:29:19,147 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/90ebd46f45b7225dbe4c67ee88719c37 2023-07-24 12:29:19,147 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-24 12:29:19,148 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-24 12:29:19,149 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-24 12:29:19,154 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230724cc53883f2b334309a54fe616d823076a to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230724cc53883f2b334309a54fe616d823076a 2023-07-24 12:29:19,158 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307249efbc8f507044a698b7cdceb6511e85c to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e202307249efbc8f507044a698b7cdceb6511e85c 2023-07-24 12:29:19,158 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-24 12:29:19,161 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 12:29:19,164 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-24 12:29:19,166 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-24 12:29:19,167 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 12:29:19,167 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-24 12:29:19,167 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690201759167"}]},"ts":"9223372036854775807"} 2023-07-24 12:29:19,167 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690201759167"}]},"ts":"9223372036854775807"} 2023-07-24 12:29:19,180 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 12:29:19,180 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f073fac22553ddc64db3e7fc2811e7c2, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690201736734.f073fac22553ddc64db3e7fc2811e7c2.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 90ebd46f45b7225dbe4c67ee88719c37, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690201736734.90ebd46f45b7225dbe4c67ee88719c37.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 12:29:19,180 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-24 12:29:19,180 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690201759180"}]},"ts":"9223372036854775807"} 2023-07-24 12:29:19,182 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-24 12:29:19,185 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 12:29:19,186 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 59 msec 2023-07-24 12:29:19,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-24 12:29:19,243 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-24 12:29:19,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(751): Client=jenkins//172.31.2.20 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-24 12:29:19,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:29:19,262 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(751): Client=jenkins//172.31.2.20 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-24 12:29:19,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 12:29:19,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(751): Client=jenkins//172.31.2.20 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-24 12:29:19,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 12:29:19,302 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=757 (was 746) Potentially hanging thread: hconnection-0x4f8b35dd-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4f8b35dd-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4f8b35dd-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4f8b35dd-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase6.apache.org/172.31.2.20:40011 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x4f8b35dd-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1338397176_17 at /127.0.0.1:42850 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4f8b35dd-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4224 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1531464478_1 at /127.0.0.1:51424 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1338397176_17 at /127.0.0.1:48386 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1338397176_17 at /127.0.0.1:51460 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=904 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=507 (was 407) - SystemLoadAverage LEAK? -, ProcessCount=176 (was 179), AvailableMemoryMB=1969 (was 1484) - AvailableMemoryMB LEAK? - 2023-07-24 12:29:19,303 WARN [Listener at jenkins-hbase6.apache.org/41373] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-24 12:29:19,336 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=757, OpenFileDescriptor=904, MaxFileDescriptor=60000, SystemLoadAverage=507, ProcessCount=176, AvailableMemoryMB=1964 2023-07-24 12:29:19,336 WARN [Listener at jenkins-hbase6.apache.org/41373] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-24 12:29:19,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.HMaster$4(2112): Client=jenkins//172.31.2.20 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 12:29:19,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 12:29:19,344 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 12:29:19,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(700): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-24 12:29:19,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 12:29:19,346 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 12:29:19,350 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testEmptyExportFileSystemState/45b21c1615789b4f09d7e60591a89501 2023-07-24 12:29:19,350 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a882b989d238c102aaf687c9b3e915a 2023-07-24 12:29:19,351 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testEmptyExportFileSystemState/45b21c1615789b4f09d7e60591a89501 empty. 2023-07-24 12:29:19,351 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a882b989d238c102aaf687c9b3e915a empty. 2023-07-24 12:29:19,351 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testEmptyExportFileSystemState/45b21c1615789b4f09d7e60591a89501 2023-07-24 12:29:19,351 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a882b989d238c102aaf687c9b3e915a 2023-07-24 12:29:19,351 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-24 12:29:19,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 12:29:19,459 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-24 12:29:19,484 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 45b21c1615789b4f09d7e60591a89501, NAME => 'testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp 2023-07-24 12:29:19,488 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8a882b989d238c102aaf687c9b3e915a, NAME => 'testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp 2023-07-24 12:29:19,531 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:29:19,531 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 8a882b989d238c102aaf687c9b3e915a, disabling compactions & flushes 2023-07-24 12:29:19,531 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a. 2023-07-24 12:29:19,531 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a. 2023-07-24 12:29:19,531 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a. after waiting 0 ms 2023-07-24 12:29:19,531 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a. 2023-07-24 12:29:19,531 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a. 2023-07-24 12:29:19,531 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 8a882b989d238c102aaf687c9b3e915a: 2023-07-24 12:29:19,534 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:29:19,534 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 45b21c1615789b4f09d7e60591a89501, disabling compactions & flushes 2023-07-24 12:29:19,534 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501. 2023-07-24 12:29:19,534 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501. 2023-07-24 12:29:19,534 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501. after waiting 0 ms 2023-07-24 12:29:19,534 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501. 2023-07-24 12:29:19,534 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501. 2023-07-24 12:29:19,534 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 45b21c1615789b4f09d7e60591a89501: 2023-07-24 12:29:19,536 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 12:29:19,537 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690201759537"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201759537"}]},"ts":"1690201759537"} 2023-07-24 12:29:19,538 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690201759537"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201759537"}]},"ts":"1690201759537"} 2023-07-24 12:29:19,540 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 12:29:19,541 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 12:29:19,541 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201759541"}]},"ts":"1690201759541"} 2023-07-24 12:29:19,544 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-24 12:29:19,550 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-07-24 12:29:19,552 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 12:29:19,552 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 12:29:19,552 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 12:29:19,552 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 12:29:19,552 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=45b21c1615789b4f09d7e60591a89501, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a882b989d238c102aaf687c9b3e915a, ASSIGN}] 2023-07-24 12:29:19,557 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a882b989d238c102aaf687c9b3e915a, ASSIGN 2023-07-24 12:29:19,557 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=45b21c1615789b4f09d7e60591a89501, ASSIGN 2023-07-24 12:29:19,563 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a882b989d238c102aaf687c9b3e915a, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,44275,1690201659331; forceNewPlan=false, retain=false 2023-07-24 12:29:19,564 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=45b21c1615789b4f09d7e60591a89501, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,44517,1690201659253; forceNewPlan=false, retain=false 2023-07-24 12:29:19,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 12:29:19,714 INFO [jenkins-hbase6:38215] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 12:29:19,716 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=45b21c1615789b4f09d7e60591a89501, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:19,716 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=8a882b989d238c102aaf687c9b3e915a, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:19,717 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690201759716"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201759716"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201759716"}]},"ts":"1690201759716"} 2023-07-24 12:29:19,717 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690201759716"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201759716"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201759716"}]},"ts":"1690201759716"} 2023-07-24 12:29:19,720 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 45b21c1615789b4f09d7e60591a89501, server=jenkins-hbase6.apache.org,44517,1690201659253}] 2023-07-24 12:29:19,720 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 8a882b989d238c102aaf687c9b3e915a, server=jenkins-hbase6.apache.org,44275,1690201659331}] 2023-07-24 12:29:19,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501. 2023-07-24 12:29:19,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 45b21c1615789b4f09d7e60591a89501, NAME => 'testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 12:29:19,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a. 2023-07-24 12:29:19,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8a882b989d238c102aaf687c9b3e915a, NAME => 'testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 12:29:19,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501. service=AccessControlService 2023-07-24 12:29:19,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a. service=AccessControlService 2023-07-24 12:29:19,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 12:29:19,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 12:29:19,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 45b21c1615789b4f09d7e60591a89501 2023-07-24 12:29:19,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 8a882b989d238c102aaf687c9b3e915a 2023-07-24 12:29:19,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:29:19,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:29:19,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 45b21c1615789b4f09d7e60591a89501 2023-07-24 12:29:19,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for 8a882b989d238c102aaf687c9b3e915a 2023-07-24 12:29:19,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 45b21c1615789b4f09d7e60591a89501 2023-07-24 12:29:19,880 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for 8a882b989d238c102aaf687c9b3e915a 2023-07-24 12:29:19,881 INFO [StoreOpener-8a882b989d238c102aaf687c9b3e915a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8a882b989d238c102aaf687c9b3e915a 2023-07-24 12:29:19,885 INFO [StoreOpener-45b21c1615789b4f09d7e60591a89501-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 45b21c1615789b4f09d7e60591a89501 2023-07-24 12:29:19,887 DEBUG [StoreOpener-8a882b989d238c102aaf687c9b3e915a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testEmptyExportFileSystemState/8a882b989d238c102aaf687c9b3e915a/cf 2023-07-24 12:29:19,888 DEBUG [StoreOpener-8a882b989d238c102aaf687c9b3e915a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testEmptyExportFileSystemState/8a882b989d238c102aaf687c9b3e915a/cf 2023-07-24 12:29:19,888 DEBUG [StoreOpener-45b21c1615789b4f09d7e60591a89501-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testEmptyExportFileSystemState/45b21c1615789b4f09d7e60591a89501/cf 2023-07-24 12:29:19,888 DEBUG [StoreOpener-45b21c1615789b4f09d7e60591a89501-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testEmptyExportFileSystemState/45b21c1615789b4f09d7e60591a89501/cf 2023-07-24 12:29:19,888 INFO [StoreOpener-8a882b989d238c102aaf687c9b3e915a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8a882b989d238c102aaf687c9b3e915a columnFamilyName cf 2023-07-24 12:29:19,889 INFO [StoreOpener-45b21c1615789b4f09d7e60591a89501-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 45b21c1615789b4f09d7e60591a89501 columnFamilyName cf 2023-07-24 12:29:19,890 INFO [StoreOpener-8a882b989d238c102aaf687c9b3e915a-1] regionserver.HStore(310): Store=8a882b989d238c102aaf687c9b3e915a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 12:29:19,890 INFO [StoreOpener-45b21c1615789b4f09d7e60591a89501-1] regionserver.HStore(310): Store=45b21c1615789b4f09d7e60591a89501/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 12:29:19,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testEmptyExportFileSystemState/8a882b989d238c102aaf687c9b3e915a 2023-07-24 12:29:19,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testEmptyExportFileSystemState/45b21c1615789b4f09d7e60591a89501 2023-07-24 12:29:19,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testEmptyExportFileSystemState/8a882b989d238c102aaf687c9b3e915a 2023-07-24 12:29:19,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testEmptyExportFileSystemState/45b21c1615789b4f09d7e60591a89501 2023-07-24 12:29:19,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 45b21c1615789b4f09d7e60591a89501 2023-07-24 12:29:19,895 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for 8a882b989d238c102aaf687c9b3e915a 2023-07-24 12:29:19,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testEmptyExportFileSystemState/45b21c1615789b4f09d7e60591a89501/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 12:29:19,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testEmptyExportFileSystemState/8a882b989d238c102aaf687c9b3e915a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 12:29:19,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 45b21c1615789b4f09d7e60591a89501; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72498391, jitterRate=0.08031021058559418}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 12:29:19,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 45b21c1615789b4f09d7e60591a89501: 2023-07-24 12:29:19,906 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened 8a882b989d238c102aaf687c9b3e915a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68840379, jitterRate=0.025801584124565125}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 12:29:19,906 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for 8a882b989d238c102aaf687c9b3e915a: 2023-07-24 12:29:19,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501., pid=93, masterSystemTime=1690201759872 2023-07-24 12:29:19,908 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a., pid=94, masterSystemTime=1690201759872 2023-07-24 12:29:19,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501. 2023-07-24 12:29:19,910 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501. 2023-07-24 12:29:19,911 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=45b21c1615789b4f09d7e60591a89501, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:19,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a. 2023-07-24 12:29:19,911 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a. 2023-07-24 12:29:19,911 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690201759910"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690201759910"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690201759910"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690201759910"}]},"ts":"1690201759910"} 2023-07-24 12:29:19,911 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=8a882b989d238c102aaf687c9b3e915a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:19,911 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690201759911"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690201759911"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690201759911"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690201759911"}]},"ts":"1690201759911"} 2023-07-24 12:29:19,914 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-24 12:29:19,914 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 45b21c1615789b4f09d7e60591a89501, server=jenkins-hbase6.apache.org,44517,1690201659253 in 192 msec 2023-07-24 12:29:19,916 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-24 12:29:19,916 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=45b21c1615789b4f09d7e60591a89501, ASSIGN in 362 msec 2023-07-24 12:29:19,916 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 8a882b989d238c102aaf687c9b3e915a, server=jenkins-hbase6.apache.org,44275,1690201659331 in 193 msec 2023-07-24 12:29:19,917 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-24 12:29:19,917 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a882b989d238c102aaf687c9b3e915a, ASSIGN in 364 msec 2023-07-24 12:29:19,918 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 12:29:19,919 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201759919"}]},"ts":"1690201759919"} 2023-07-24 12:29:19,920 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-24 12:29:19,929 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 12:29:19,929 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-24 12:29:19,931 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36595] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 12:29:19,932 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:19,933 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:19,933 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:19,933 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:19,934 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 12:29:19,934 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 12:29:19,934 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 12:29:19,934 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 12:29:19,936 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 596 msec 2023-07-24 12:29:19,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 12:29:19,950 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-24 12:29:19,952 DEBUG [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-24 12:29:19,952 DEBUG [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501. 2023-07-24 12:29:19,955 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 12:29:19,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1583): Client=jenkins//172.31.2.20 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 12:29:19,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690201759970 (current time:1690201759970). 2023-07-24 12:29:19,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 12:29:19,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(139): Connect 0x1555fb5b to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:29:19,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@575b8822, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:29:19,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:29:19,997 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:33222, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:29:19,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1555fb5b to 127.0.0.1:49553 2023-07-24 12:29:19,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:29:19,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(139): Connect 0x1a54e5f2 to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:29:20,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20615ac0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:29:20,115 DEBUG [hconnection-0x2b70dc76-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:29:20,120 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:33232, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:29:20,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:29:20,128 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:52290, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:29:20,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1a54e5f2 to 127.0.0.1:49553 2023-07-24 12:29:20,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:29:20,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 12:29:20,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 12:29:20,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 12:29:20,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 12:29:20,138 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 12:29:20,139 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690202360139 2023-07-24 12:29:20,139 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-24 12:29:20,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 12:29:20,143 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 12:29:20,144 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 12:29:20,143 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 12:29:20,145 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 12:29:20,147 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 13 msec 2023-07-24 12:29:20,151 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 12:29:20,152 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690202360152 2023-07-24 12:29:20,173 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,173 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-24 12:29:20,173 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:29:20,175 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-24 12:29:20,175 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-24 12:29:20,176 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,176 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,182 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:20,182 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:20,182 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:20,182 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:20,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:20,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:20,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:20,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:20,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,183 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:20,183 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:20,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:20,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,187 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,187 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 12:29:20,187 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 12:29:20,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,188 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 12:29:20,188 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,188 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 12:29:20,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,189 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 12:29:20,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 12:29:20,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,189 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 12:29:20,190 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,190 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 12:29:20,190 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:29:20,192 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 12:29:20,192 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 12:29:20,192 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,192 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,36595,1690201659396' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 12:29:20,192 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 12:29:20,192 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:29:20,192 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,194 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 12:29:20,194 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:29:20,194 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 12:29:20,201 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 12:29:20,201 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44517,1690201659253' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 12:29:20,200 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 12:29:20,201 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 12:29:20,201 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44275,1690201659331' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 12:29:20,203 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,204 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,204 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,204 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,204 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:29:20,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:29:20,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:29:20,204 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,204 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:29:20,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:29:20,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:29:20,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:20,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:29:20,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,44275,1690201659331' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 12:29:20,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10bb02cb[Count = 1] remaining members to acquire global barrier 2023-07-24 12:29:20,208 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:20,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:20,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:29:20,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:29:20,209 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:29:20,209 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,209 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:29:20,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:29:20,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:20,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:20,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:29:20,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,44517,1690201659253' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 12:29:20,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10bb02cb[Count = 0] remaining members to acquire global barrier 2023-07-24 12:29:20,211 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 12:29:20,212 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,215 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,215 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 12:29:20,215 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,215 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:20,215 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 12:29:20,219 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,219 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 12:29:20,219 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 12:29:20,220 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase6.apache.org,36595,1690201659396' in zk 2023-07-24 12:29:20,219 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,220 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 12:29:20,221 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 12:29:20,221 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:29:20,221 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 12:29:20,225 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 12:29:20,230 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 12:29:20,230 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a. 2023-07-24 12:29:20,230 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a. started... 2023-07-24 12:29:20,229 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501. 2023-07-24 12:29:20,228 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 12:29:20,235 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 12:29:20,235 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501. started... 2023-07-24 12:29:20,232 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8a882b989d238c102aaf687c9b3e915a: 2023-07-24 12:29:20,236 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 45b21c1615789b4f09d7e60591a89501: 2023-07-24 12:29:20,236 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,236 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 12:29:20,236 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,236 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 12:29:20,236 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 12:29:20,236 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 12:29:20,245 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:29:20,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 12:29:20,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:29:20,246 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 12:29:20,292 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501. completed. 2023-07-24 12:29:20,292 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501. 2023-07-24 12:29:20,292 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 12:29:20,292 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 12:29:20,292 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:20,292 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 12:29:20,292 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase6.apache.org,44517,1690201659253' in zk 2023-07-24 12:29:20,294 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a. completed. 2023-07-24 12:29:20,294 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 12:29:20,294 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a. 2023-07-24 12:29:20,294 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:20,294 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 12:29:20,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:20,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:29:20,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:29:20,294 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:29:20,294 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 12:29:20,294 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 12:29:20,294 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,296 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 12:29:20,296 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase6.apache.org,44275,1690201659331' in zk 2023-07-24 12:29:20,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:29:20,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:29:20,298 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 12:29:20,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,298 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,298 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:29:20,298 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 12:29:20,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:20,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:20,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:29:20,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:20,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:20,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase6.apache.org,44517,1690201659253': 2023-07-24 12:29:20,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,44517,1690201659253' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 12:29:20,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:29:20,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:29:20,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:29:20,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:29:20,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:20,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:20,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:29:20,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:20,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:20,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase6.apache.org,44275,1690201659331': 2023-07-24 12:29:20,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,44275,1690201659331' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 12:29:20,305 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-24 12:29:20,305 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 12:29:20,305 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 12:29:20,305 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,305 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 12:29:20,308 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,308 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,308 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:20,308 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:20,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:20,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:20,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:20,315 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:20,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:29:20,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:29:20,315 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,315 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:20,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:29:20,315 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:20,315 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:20,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:20,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,316 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:20,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:29:20,316 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:20,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:20,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:29:20,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,318 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:20,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:20,319 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:20,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:20,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,320 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,323 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,323 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:20,323 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,323 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:20,323 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:20,323 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,323 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:20,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:20,323 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,323 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:20,323 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:20,323 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:20,323 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:20,323 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:20,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:20,324 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,324 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:29:20,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:20,324 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,324 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,326 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-24 12:29:20,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,326 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 12:29:20,326 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:20,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:20,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:20,327 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 12:29:20,327 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:20,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:20,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:20,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:20,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:20,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:20,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:20,351 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,352 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,423 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,446 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:29:20,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 12:29:20,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:29:20,448 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 12:29:20,490 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-24 12:29:20,490 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,491 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,491 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690201760139Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1690201760351 (+212 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690201760351Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1690201760351Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1690201760366 (+15 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690201760406 (+40 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690201760490 (+84 ms) 2023-07-24 12:29:20,495 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 12:29:20,498 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 353 msec 2023-07-24 12:29:20,748 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:29:20,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 12:29:20,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 12:29:20,757 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44517] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 12:29:20,758 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44275] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 12:29:20,761 DEBUG [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-24 12:29:20,761 DEBUG [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501. 2023-07-24 12:29:20,762 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 12:29:20,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1583): Client=jenkins//172.31.2.20 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 12:29:20,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690201760775 (current time:1690201760775). 2023-07-24 12:29:20,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 12:29:20,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(139): Connect 0x669050cb to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:29:20,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4baea303, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:29:20,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:29:20,807 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:33234, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:29:20,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x669050cb to 127.0.0.1:49553 2023-07-24 12:29:20,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:29:20,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(139): Connect 0x46e09545 to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:29:20,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2212935a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:29:20,832 DEBUG [hconnection-0x1c1a9aa0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:29:20,833 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:33244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:29:20,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:29:20,844 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:52306, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:29:20,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46e09545 to 127.0.0.1:49553 2023-07-24 12:29:20,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:29:20,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 12:29:20,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 12:29:20,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 12:29:20,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 12:29:20,850 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 12:29:20,851 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690202360851 2023-07-24 12:29:20,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 12:29:20,851 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-24 12:29:20,863 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 12:29:20,863 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 12:29:20,865 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 12:29:20,866 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 12:29:20,869 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 18 msec 2023-07-24 12:29:20,872 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 12:29:20,875 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690202360875 2023-07-24 12:29:20,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,931 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-24 12:29:20,932 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:29:20,933 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-24 12:29:20,933 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-24 12:29:20,934 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,934 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,935 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:20,935 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:20,936 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:20,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:20,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:20,936 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:20,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:20,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:20,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:20,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:20,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,936 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:20,936 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,937 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,937 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,937 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 12:29:20,937 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,937 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 12:29:20,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,938 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 12:29:20,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 12:29:20,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 12:29:20,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,938 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,938 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 12:29:20,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,938 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 12:29:20,939 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:29:20,939 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 12:29:20,939 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,939 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,939 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 12:29:20,939 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 12:29:20,939 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:29:20,939 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:29:20,940 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 12:29:20,944 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 12:29:20,944 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 12:29:20,944 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44275,1690201659331' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 12:29:20,944 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 12:29:20,944 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 12:29:20,944 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,36595,1690201659396' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 12:29:20,944 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 12:29:20,945 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44517,1690201659253' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 12:29:20,946 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:20,946 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,946 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:20,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:29:20,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:29:20,946 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,947 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,947 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,947 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:29:20,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:29:20,947 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,947 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,948 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:29:20,948 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:29:20,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:29:20,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:20,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:20,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:29:20,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,44517,1690201659253' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 12:29:20,950 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4128e5bd[Count = 1] remaining members to acquire global barrier 2023-07-24 12:29:20,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:29:20,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:29:20,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:29:20,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:29:20,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:20,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:20,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:29:20,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,44275,1690201659331' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 12:29:20,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4128e5bd[Count = 0] remaining members to acquire global barrier 2023-07-24 12:29:20,953 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 12:29:20,953 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,961 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,961 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,961 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,961 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 12:29:20,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:20,961 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 12:29:20,961 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase6.apache.org,36595,1690201659396' in zk 2023-07-24 12:29:20,961 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 12:29:20,961 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 12:29:20,961 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:20,962 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:20,962 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 12:29:20,963 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 12:29:20,963 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:29:20,963 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 12:29:20,963 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:29:20,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 12:29:20,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:29:20,965 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 12:29:20,965 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 12:29:20,965 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 12:29:20,978 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 12:29:20,978 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 12:29:20,978 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501. 2023-07-24 12:29:20,978 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a. 2023-07-24 12:29:20,979 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501. started... 2023-07-24 12:29:20,979 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a. started... 2023-07-24 12:29:20,979 INFO [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 45b21c1615789b4f09d7e60591a89501 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-24 12:29:20,979 INFO [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8a882b989d238c102aaf687c9b3e915a 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-24 12:29:21,072 INFO [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230724a05a7307acc64246afb4e70cd5789de3 to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230724a05a7307acc64246afb4e70cd5789de3 2023-07-24 12:29:21,116 INFO [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072419b6550b5cf84f989cbf1f55b3b5b04b to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023072419b6550b5cf84f989cbf1f55b3b5b04b 2023-07-24 12:29:21,133 INFO [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testEmptyExportFileSystemState/45b21c1615789b4f09d7e60591a89501/.tmp/cf/a6337376e0fa4d33955f197bfaa7e167 2023-07-24 12:29:21,143 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testEmptyExportFileSystemState/45b21c1615789b4f09d7e60591a89501/.tmp/cf/a6337376e0fa4d33955f197bfaa7e167 as hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testEmptyExportFileSystemState/45b21c1615789b4f09d7e60591a89501/cf/a6337376e0fa4d33955f197bfaa7e167 2023-07-24 12:29:21,150 INFO [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testEmptyExportFileSystemState/45b21c1615789b4f09d7e60591a89501/cf/a6337376e0fa4d33955f197bfaa7e167, entries=5, sequenceid=6, filesize=5.8 K 2023-07-24 12:29:21,151 INFO [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 45b21c1615789b4f09d7e60591a89501 in 172ms, sequenceid=6, compaction requested=false 2023-07-24 12:29:21,152 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-24 12:29:21,154 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 45b21c1615789b4f09d7e60591a89501: 2023-07-24 12:29:21,154 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,154 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 12:29:21,154 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testEmptyExportFileSystemState/45b21c1615789b4f09d7e60591a89501/cf/a6337376e0fa4d33955f197bfaa7e167] hfiles 2023-07-24 12:29:21,154 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testEmptyExportFileSystemState/45b21c1615789b4f09d7e60591a89501/cf/a6337376e0fa4d33955f197bfaa7e167 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,165 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:29:21,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 12:29:21,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:29:21,166 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 12:29:21,183 INFO [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testEmptyExportFileSystemState/8a882b989d238c102aaf687c9b3e915a/.tmp/cf/15e7c7aaeac24fcabf9837ffe77b20d7 2023-07-24 12:29:21,199 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testEmptyExportFileSystemState/8a882b989d238c102aaf687c9b3e915a/.tmp/cf/15e7c7aaeac24fcabf9837ffe77b20d7 as hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testEmptyExportFileSystemState/8a882b989d238c102aaf687c9b3e915a/cf/15e7c7aaeac24fcabf9837ffe77b20d7 2023-07-24 12:29:21,206 INFO [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testEmptyExportFileSystemState/8a882b989d238c102aaf687c9b3e915a/cf/15e7c7aaeac24fcabf9837ffe77b20d7, entries=45, sequenceid=6, filesize=12.7 K 2023-07-24 12:29:21,207 INFO [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 8a882b989d238c102aaf687c9b3e915a in 228ms, sequenceid=6, compaction requested=false 2023-07-24 12:29:21,209 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8a882b989d238c102aaf687c9b3e915a: 2023-07-24 12:29:21,209 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,210 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 12:29:21,210 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testEmptyExportFileSystemState/8a882b989d238c102aaf687c9b3e915a/cf/15e7c7aaeac24fcabf9837ffe77b20d7] hfiles 2023-07-24 12:29:21,210 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testEmptyExportFileSystemState/8a882b989d238c102aaf687c9b3e915a/cf/15e7c7aaeac24fcabf9837ffe77b20d7 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,213 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501. completed. 2023-07-24 12:29:21,214 DEBUG [rs(jenkins-hbase6.apache.org,44517,1690201659253)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501. 2023-07-24 12:29:21,214 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 12:29:21,214 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 12:29:21,214 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:21,214 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 12:29:21,214 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase6.apache.org,44517,1690201659253' in zk 2023-07-24 12:29:21,215 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:21,216 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 12:29:21,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:21,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:29:21,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:29:21,216 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:29:21,216 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 12:29:21,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:29:21,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:29:21,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:21,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:21,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:21,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:29:21,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:21,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:21,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase6.apache.org,44517,1690201659253': 2023-07-24 12:29:21,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,44517,1690201659253' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 12:29:21,248 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a. completed. 2023-07-24 12:29:21,248 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a. 2023-07-24 12:29:21,248 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 12:29:21,249 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 12:29:21,249 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:21,249 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 12:29:21,249 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase6.apache.org,44275,1690201659331' in zk 2023-07-24 12:29:21,252 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 12:29:21,252 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:21,252 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:29:21,252 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 12:29:21,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:21,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:29:21,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:29:21,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:29:21,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:29:21,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:21,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:21,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:21,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:29:21,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:21,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:21,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:21,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase6.apache.org,44275,1690201659331': 2023-07-24 12:29:21,260 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,44275,1690201659331' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 12:29:21,260 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-24 12:29:21,260 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 12:29:21,260 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 12:29:21,260 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,260 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 12:29:21,262 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,262 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:21,262 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,262 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,262 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:21,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:29:21,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:29:21,262 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:21,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,263 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:21,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:21,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:21,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:21,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:21,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:21,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:29:21,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,265 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:21,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,265 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:21,266 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:21,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:29:21,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:21,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:21,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:21,271 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:21,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:29:21,272 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:21,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,272 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:21,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:21,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:21,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:21,276 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:21,276 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:21,276 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:21,276 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,276 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:21,276 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:29:21,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:21,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:21,276 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:21,278 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:21,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:21,276 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:21,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:21,276 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:21,276 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,276 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:21,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:21,279 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-24 12:29:21,279 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,279 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:21,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 12:29:21,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:21,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:21,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:21,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:21,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:21,279 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,280 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:21,280 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:21,280 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,280 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,280 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023072419b6550b5cf84f989cbf1f55b3b5b04b, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230724a05a7307acc64246afb4e70cd5789de3] mob files 2023-07-24 12:29:21,280 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023072419b6550b5cf84f989cbf1f55b3b5b04b 2023-07-24 12:29:21,280 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230724a05a7307acc64246afb4e70cd5789de3 2023-07-24 12:29:21,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:21,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:21,349 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,350 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,457 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-24 12:29:21,457 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,458 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,458 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690201760852Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1690201761349 (+497 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1690201761349Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1690201761349Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1690201761375 (+26 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1690201761409 (+34 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690201761457 (+48 ms) 2023-07-24 12:29:21,466 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:29:21,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 12:29:21,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 12:29:21,468 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201761468 2023-07-24 12:29:21,470 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42387, tgtDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201761468, rawTgtDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201761468, srcFsUri=hdfs://localhost:42387, srcDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa 2023-07-24 12:29:21,470 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 12:29:21,473 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 608 msec 2023-07-24 12:29:21,509 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42387, inputRoot=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa 2023-07-24 12:29:21,509 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-932925438_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201761468, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201761468/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,509 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42387, inputRoot=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa, snapshotDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-24 12:29:21,529 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201761468/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:21,613 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:21,613 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:21,614 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:21,615 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:21,615 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:21,615 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:21,616 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:21,719 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/hadoop-7143644288081748416.jar 2023-07-24 12:29:21,719 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:21,720 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:21,720 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:21,720 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:21,721 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:21,721 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:21,721 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 12:29:21,722 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 12:29:21,722 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 12:29:21,722 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 12:29:21,722 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 12:29:21,723 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 12:29:21,723 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 12:29:21,724 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 12:29:21,724 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 12:29:21,725 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 12:29:21,725 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:29:21,725 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:29:21,726 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 12:29:21,726 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:29:21,726 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:29:21,726 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 12:29:21,727 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 12:29:22,703 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0005_000001 (auth:SIMPLE) 2023-07-24 12:29:23,156 WARN [Listener at jenkins-hbase6.apache.org/41373] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 12:29:23,162 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-24 12:29:23,468 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 12:29:23,468 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 12:29:23,699 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 12:29:23,701 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0006_000001 (auth:SIMPLE) 2023-07-24 12:29:29,131 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0006_000001 (auth:SIMPLE) 2023-07-24 12:29:31,813 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 12:29:31,814 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 12:29:31,824 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:31,825 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 12:29:31,825 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 12:29:31,825 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1338397176_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:31,826 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-24 12:29:31,826 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-24 12:29:31,826 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1338397176_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201761468/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201761468/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:31,827 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201761468/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-24 12:29:31,827 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201761468/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-24 12:29:31,835 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-24 12:29:31,836 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.HMaster$11(2418): Client=jenkins//172.31.2.20 disable testtb-testEmptyExportFileSystemState 2023-07-24 12:29:31,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 12:29:31,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 12:29:31,849 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201771849"}]},"ts":"1690201771849"} 2023-07-24 12:29:31,851 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-24 12:29:31,853 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-24 12:29:31,854 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=45b21c1615789b4f09d7e60591a89501, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a882b989d238c102aaf687c9b3e915a, UNASSIGN}] 2023-07-24 12:29:31,867 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=45b21c1615789b4f09d7e60591a89501, UNASSIGN 2023-07-24 12:29:31,869 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a882b989d238c102aaf687c9b3e915a, UNASSIGN 2023-07-24 12:29:31,870 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=45b21c1615789b4f09d7e60591a89501, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:31,870 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=8a882b989d238c102aaf687c9b3e915a, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:31,870 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690201771870"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201771870"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201771870"}]},"ts":"1690201771870"} 2023-07-24 12:29:31,870 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690201771870"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201771870"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201771870"}]},"ts":"1690201771870"} 2023-07-24 12:29:31,874 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 45b21c1615789b4f09d7e60591a89501, server=jenkins-hbase6.apache.org,44517,1690201659253}] 2023-07-24 12:29:31,874 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 8a882b989d238c102aaf687c9b3e915a, server=jenkins-hbase6.apache.org,44275,1690201659331}] 2023-07-24 12:29:31,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 12:29:32,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(111): Close 8a882b989d238c102aaf687c9b3e915a 2023-07-24 12:29:32,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(111): Close 45b21c1615789b4f09d7e60591a89501 2023-07-24 12:29:32,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 8a882b989d238c102aaf687c9b3e915a, disabling compactions & flushes 2023-07-24 12:29:32,027 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 45b21c1615789b4f09d7e60591a89501, disabling compactions & flushes 2023-07-24 12:29:32,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501. 2023-07-24 12:29:32,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501. 2023-07-24 12:29:32,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501. after waiting 0 ms 2023-07-24 12:29:32,028 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501. 2023-07-24 12:29:32,027 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a. 2023-07-24 12:29:32,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a. 2023-07-24 12:29:32,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a. after waiting 0 ms 2023-07-24 12:29:32,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a. 2023-07-24 12:29:32,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testEmptyExportFileSystemState/45b21c1615789b4f09d7e60591a89501/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 12:29:32,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testEmptyExportFileSystemState/8a882b989d238c102aaf687c9b3e915a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 12:29:32,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 12:29:32,059 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 12:29:32,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501. 2023-07-24 12:29:32,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 45b21c1615789b4f09d7e60591a89501: 2023-07-24 12:29:32,060 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a. 2023-07-24 12:29:32,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 8a882b989d238c102aaf687c9b3e915a: 2023-07-24 12:29:32,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(149): Closed 45b21c1615789b4f09d7e60591a89501 2023-07-24 12:29:32,062 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=45b21c1615789b4f09d7e60591a89501, regionState=CLOSED 2023-07-24 12:29:32,062 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690201772062"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201772062"}]},"ts":"1690201772062"} 2023-07-24 12:29:32,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(149): Closed 8a882b989d238c102aaf687c9b3e915a 2023-07-24 12:29:32,063 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=8a882b989d238c102aaf687c9b3e915a, regionState=CLOSED 2023-07-24 12:29:32,063 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690201772063"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201772063"}]},"ts":"1690201772063"} 2023-07-24 12:29:32,066 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-24 12:29:32,066 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 45b21c1615789b4f09d7e60591a89501, server=jenkins-hbase6.apache.org,44517,1690201659253 in 192 msec 2023-07-24 12:29:32,067 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-24 12:29:32,067 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=45b21c1615789b4f09d7e60591a89501, UNASSIGN in 212 msec 2023-07-24 12:29:32,067 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 8a882b989d238c102aaf687c9b3e915a, server=jenkins-hbase6.apache.org,44275,1690201659331 in 191 msec 2023-07-24 12:29:32,069 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-24 12:29:32,069 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8a882b989d238c102aaf687c9b3e915a, UNASSIGN in 213 msec 2023-07-24 12:29:32,069 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201772069"}]},"ts":"1690201772069"} 2023-07-24 12:29:32,070 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-24 12:29:32,072 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-24 12:29:32,078 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 240 msec 2023-07-24 12:29:32,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 12:29:32,151 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-24 12:29:32,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.HMaster$5(2228): Client=jenkins//172.31.2.20 delete testtb-testEmptyExportFileSystemState 2023-07-24 12:29:32,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 12:29:32,156 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 12:29:32,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-24 12:29:32,157 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 12:29:32,158 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36595] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-24 12:29:32,162 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 12:29:32,162 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 12:29:32,162 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 12:29:32,162 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 12:29:32,163 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a882b989d238c102aaf687c9b3e915a 2023-07-24 12:29:32,163 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testEmptyExportFileSystemState/45b21c1615789b4f09d7e60591a89501 2023-07-24 12:29:32,163 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 12:29:32,163 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 12:29:32,163 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:32,163 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 12:29:32,163 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:32,164 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-24 12:29:32,163 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 12:29:32,164 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 12:29:32,163 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:32,163 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:32,164 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-24 12:29:32,164 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 12:29:32,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-24 12:29:32,165 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a882b989d238c102aaf687c9b3e915a/cf, FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a882b989d238c102aaf687c9b3e915a/recovered.edits] 2023-07-24 12:29:32,166 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testEmptyExportFileSystemState/45b21c1615789b4f09d7e60591a89501/cf, FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testEmptyExportFileSystemState/45b21c1615789b4f09d7e60591a89501/recovered.edits] 2023-07-24 12:29:32,177 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a882b989d238c102aaf687c9b3e915a/cf/15e7c7aaeac24fcabf9837ffe77b20d7 to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testEmptyExportFileSystemState/8a882b989d238c102aaf687c9b3e915a/cf/15e7c7aaeac24fcabf9837ffe77b20d7 2023-07-24 12:29:32,179 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testEmptyExportFileSystemState/45b21c1615789b4f09d7e60591a89501/cf/a6337376e0fa4d33955f197bfaa7e167 to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testEmptyExportFileSystemState/45b21c1615789b4f09d7e60591a89501/cf/a6337376e0fa4d33955f197bfaa7e167 2023-07-24 12:29:32,181 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a882b989d238c102aaf687c9b3e915a/recovered.edits/9.seqid to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testEmptyExportFileSystemState/8a882b989d238c102aaf687c9b3e915a/recovered.edits/9.seqid 2023-07-24 12:29:32,182 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testEmptyExportFileSystemState/8a882b989d238c102aaf687c9b3e915a 2023-07-24 12:29:32,183 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testEmptyExportFileSystemState/45b21c1615789b4f09d7e60591a89501/recovered.edits/9.seqid to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testEmptyExportFileSystemState/45b21c1615789b4f09d7e60591a89501/recovered.edits/9.seqid 2023-07-24 12:29:32,184 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testEmptyExportFileSystemState/45b21c1615789b4f09d7e60591a89501 2023-07-24 12:29:32,184 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-24 12:29:32,185 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-24 12:29:32,185 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-24 12:29:32,190 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023072419b6550b5cf84f989cbf1f55b3b5b04b to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b2023072419b6550b5cf84f989cbf1f55b3b5b04b 2023-07-24 12:29:32,191 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230724a05a7307acc64246afb4e70cd5789de3 to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230724a05a7307acc64246afb4e70cd5789de3 2023-07-24 12:29:32,192 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-24 12:29:32,194 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 12:29:32,197 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-24 12:29:32,199 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-24 12:29:32,201 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 12:29:32,201 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-24 12:29:32,201 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690201772201"}]},"ts":"9223372036854775807"} 2023-07-24 12:29:32,201 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690201772201"}]},"ts":"9223372036854775807"} 2023-07-24 12:29:32,204 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 12:29:32,204 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 45b21c1615789b4f09d7e60591a89501, NAME => 'testtb-testEmptyExportFileSystemState,,1690201759337.45b21c1615789b4f09d7e60591a89501.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8a882b989d238c102aaf687c9b3e915a, NAME => 'testtb-testEmptyExportFileSystemState,1,1690201759337.8a882b989d238c102aaf687c9b3e915a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 12:29:32,204 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-24 12:29:32,204 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690201772204"}]},"ts":"9223372036854775807"} 2023-07-24 12:29:32,205 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-24 12:29:32,208 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 12:29:32,212 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 56 msec 2023-07-24 12:29:32,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-24 12:29:32,266 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-24 12:29:32,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(751): Client=jenkins//172.31.2.20 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-24 12:29:32,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:32,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(751): Client=jenkins//172.31.2.20 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-24 12:29:32,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-24 12:29:32,306 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=762 (was 757) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase6.apache.org/172.31.2.20:40259 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1338397176_17 at /127.0.0.1:54032 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1556400003_1 at /127.0.0.1:48854 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1338397176_17 at /127.0.0.1:48862 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4f8b35dd-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4f8b35dd-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4f8b35dd-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase6.apache.org/172.31.2.20:45909 from appattempt_1690201666984_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1338397176_17 at /127.0.0.1:41824 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1556400003_1 at /127.0.0.1:41774 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4908 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4f8b35dd-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase6.apache.org/172.31.2.20:45909 from appattempt_1690201666984_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase6.apache.org/172.31.2.20:46133 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=925 (was 904) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=583 (was 507) - SystemLoadAverage LEAK? -, ProcessCount=176 (was 176), AvailableMemoryMB=903 (was 1964) 2023-07-24 12:29:32,307 WARN [Listener at jenkins-hbase6.apache.org/41373] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-24 12:29:32,332 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=583, ProcessCount=176, AvailableMemoryMB=899 2023-07-24 12:29:32,332 WARN [Listener at jenkins-hbase6.apache.org/41373] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-24 12:29:32,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.HMaster$4(2112): Client=jenkins//172.31.2.20 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 12:29:32,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:32,338 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 12:29:32,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(700): Client=jenkins//172.31.2.20 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-24 12:29:32,339 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 12:29:32,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 12:29:32,342 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a4dcc110f19379a2ecbc3912dd53fb48 2023-07-24 12:29:32,342 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f375b79e815cb906c36591db42d20dcc 2023-07-24 12:29:32,343 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a4dcc110f19379a2ecbc3912dd53fb48 empty. 2023-07-24 12:29:32,343 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f375b79e815cb906c36591db42d20dcc empty. 2023-07-24 12:29:32,343 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a4dcc110f19379a2ecbc3912dd53fb48 2023-07-24 12:29:32,344 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f375b79e815cb906c36591db42d20dcc 2023-07-24 12:29:32,344 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-24 12:29:32,355 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-24 12:29:32,356 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => a4dcc110f19379a2ecbc3912dd53fb48, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp 2023-07-24 12:29:32,356 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => f375b79e815cb906c36591db42d20dcc, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp 2023-07-24 12:29:32,403 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:29:32,404 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing a4dcc110f19379a2ecbc3912dd53fb48, disabling compactions & flushes 2023-07-24 12:29:32,404 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48. 2023-07-24 12:29:32,404 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48. 2023-07-24 12:29:32,404 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48. after waiting 0 ms 2023-07-24 12:29:32,404 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48. 2023-07-24 12:29:32,404 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48. 2023-07-24 12:29:32,404 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for a4dcc110f19379a2ecbc3912dd53fb48: 2023-07-24 12:29:32,428 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:29:32,428 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing f375b79e815cb906c36591db42d20dcc, disabling compactions & flushes 2023-07-24 12:29:32,428 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc. 2023-07-24 12:29:32,429 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc. 2023-07-24 12:29:32,429 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc. after waiting 0 ms 2023-07-24 12:29:32,429 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc. 2023-07-24 12:29:32,429 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc. 2023-07-24 12:29:32,429 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for f375b79e815cb906c36591db42d20dcc: 2023-07-24 12:29:32,432 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 12:29:32,433 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690201772433"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201772433"}]},"ts":"1690201772433"} 2023-07-24 12:29:32,433 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690201772433"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201772433"}]},"ts":"1690201772433"} 2023-07-24 12:29:32,436 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 12:29:32,437 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 12:29:32,437 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201772437"}]},"ts":"1690201772437"} 2023-07-24 12:29:32,438 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-24 12:29:32,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 12:29:32,445 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase6.apache.org=0} racks are {/default-rack=0} 2023-07-24 12:29:32,447 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 12:29:32,447 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 12:29:32,447 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 12:29:32,447 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 12:29:32,448 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a4dcc110f19379a2ecbc3912dd53fb48, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f375b79e815cb906c36591db42d20dcc, ASSIGN}] 2023-07-24 12:29:32,452 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f375b79e815cb906c36591db42d20dcc, ASSIGN 2023-07-24 12:29:32,452 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a4dcc110f19379a2ecbc3912dd53fb48, ASSIGN 2023-07-24 12:29:32,453 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f375b79e815cb906c36591db42d20dcc, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,44275,1690201659331; forceNewPlan=false, retain=false 2023-07-24 12:29:32,453 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a4dcc110f19379a2ecbc3912dd53fb48, ASSIGN; state=OFFLINE, location=jenkins-hbase6.apache.org,36595,1690201659396; forceNewPlan=false, retain=false 2023-07-24 12:29:32,603 INFO [jenkins-hbase6:38215] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 12:29:32,607 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=a4dcc110f19379a2ecbc3912dd53fb48, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:32,607 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=f375b79e815cb906c36591db42d20dcc, regionState=OPENING, regionLocation=jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:32,608 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690201772607"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201772607"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201772607"}]},"ts":"1690201772607"} 2023-07-24 12:29:32,607 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690201772607"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201772607"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201772607"}]},"ts":"1690201772607"} 2023-07-24 12:29:32,610 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure f375b79e815cb906c36591db42d20dcc, server=jenkins-hbase6.apache.org,44275,1690201659331}] 2023-07-24 12:29:32,611 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure a4dcc110f19379a2ecbc3912dd53fb48, server=jenkins-hbase6.apache.org,36595,1690201659396}] 2023-07-24 12:29:32,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 12:29:32,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc. 2023-07-24 12:29:32,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f375b79e815cb906c36591db42d20dcc, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 12:29:32,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc. service=AccessControlService 2023-07-24 12:29:32,785 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48. 2023-07-24 12:29:32,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a4dcc110f19379a2ecbc3912dd53fb48, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 12:29:32,785 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 12:29:32,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48. service=AccessControlService 2023-07-24 12:29:32,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp f375b79e815cb906c36591db42d20dcc 2023-07-24 12:29:32,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 12:29:32,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:29:32,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp a4dcc110f19379a2ecbc3912dd53fb48 2023-07-24 12:29:32,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for f375b79e815cb906c36591db42d20dcc 2023-07-24 12:29:32,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 12:29:32,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for f375b79e815cb906c36591db42d20dcc 2023-07-24 12:29:32,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7894): checking encryption for a4dcc110f19379a2ecbc3912dd53fb48 2023-07-24 12:29:32,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(7897): checking classloading for a4dcc110f19379a2ecbc3912dd53fb48 2023-07-24 12:29:32,787 INFO [StoreOpener-a4dcc110f19379a2ecbc3912dd53fb48-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a4dcc110f19379a2ecbc3912dd53fb48 2023-07-24 12:29:32,787 INFO [StoreOpener-f375b79e815cb906c36591db42d20dcc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f375b79e815cb906c36591db42d20dcc 2023-07-24 12:29:32,789 DEBUG [StoreOpener-a4dcc110f19379a2ecbc3912dd53fb48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithSkipTmp/a4dcc110f19379a2ecbc3912dd53fb48/cf 2023-07-24 12:29:32,789 DEBUG [StoreOpener-a4dcc110f19379a2ecbc3912dd53fb48-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithSkipTmp/a4dcc110f19379a2ecbc3912dd53fb48/cf 2023-07-24 12:29:32,789 DEBUG [StoreOpener-f375b79e815cb906c36591db42d20dcc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithSkipTmp/f375b79e815cb906c36591db42d20dcc/cf 2023-07-24 12:29:32,789 DEBUG [StoreOpener-f375b79e815cb906c36591db42d20dcc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithSkipTmp/f375b79e815cb906c36591db42d20dcc/cf 2023-07-24 12:29:32,790 INFO [StoreOpener-a4dcc110f19379a2ecbc3912dd53fb48-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a4dcc110f19379a2ecbc3912dd53fb48 columnFamilyName cf 2023-07-24 12:29:32,790 INFO [StoreOpener-f375b79e815cb906c36591db42d20dcc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f375b79e815cb906c36591db42d20dcc columnFamilyName cf 2023-07-24 12:29:32,792 INFO [StoreOpener-f375b79e815cb906c36591db42d20dcc-1] regionserver.HStore(310): Store=f375b79e815cb906c36591db42d20dcc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 12:29:32,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithSkipTmp/f375b79e815cb906c36591db42d20dcc 2023-07-24 12:29:32,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithSkipTmp/f375b79e815cb906c36591db42d20dcc 2023-07-24 12:29:32,797 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for f375b79e815cb906c36591db42d20dcc 2023-07-24 12:29:32,797 INFO [StoreOpener-a4dcc110f19379a2ecbc3912dd53fb48-1] regionserver.HStore(310): Store=a4dcc110f19379a2ecbc3912dd53fb48/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 12:29:32,802 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithSkipTmp/a4dcc110f19379a2ecbc3912dd53fb48 2023-07-24 12:29:32,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithSkipTmp/a4dcc110f19379a2ecbc3912dd53fb48 2023-07-24 12:29:32,808 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithSkipTmp/f375b79e815cb906c36591db42d20dcc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 12:29:32,809 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened f375b79e815cb906c36591db42d20dcc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63889989, jitterRate=-0.047964975237846375}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 12:29:32,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for f375b79e815cb906c36591db42d20dcc: 2023-07-24 12:29:32,809 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc., pid=108, masterSystemTime=1690201772777 2023-07-24 12:29:32,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc. 2023-07-24 12:29:32,811 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc. 2023-07-24 12:29:32,812 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=f375b79e815cb906c36591db42d20dcc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:32,812 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690201772812"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690201772812"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690201772812"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690201772812"}]},"ts":"1690201772812"} 2023-07-24 12:29:32,815 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-24 12:29:32,815 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure f375b79e815cb906c36591db42d20dcc, server=jenkins-hbase6.apache.org,44275,1690201659331 in 203 msec 2023-07-24 12:29:32,817 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f375b79e815cb906c36591db42d20dcc, ASSIGN in 367 msec 2023-07-24 12:29:32,824 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1055): writing seq id for a4dcc110f19379a2ecbc3912dd53fb48 2023-07-24 12:29:32,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithSkipTmp/a4dcc110f19379a2ecbc3912dd53fb48/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 12:29:32,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1072): Opened a4dcc110f19379a2ecbc3912dd53fb48; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68066653, jitterRate=0.014272168278694153}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 12:29:32,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(965): Region open journal for a4dcc110f19379a2ecbc3912dd53fb48: 2023-07-24 12:29:32,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48., pid=109, masterSystemTime=1690201772777 2023-07-24 12:29:32,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48. 2023-07-24 12:29:32,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase6:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48. 2023-07-24 12:29:32,838 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=a4dcc110f19379a2ecbc3912dd53fb48, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:32,838 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690201772838"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690201772838"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690201772838"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690201772838"}]},"ts":"1690201772838"} 2023-07-24 12:29:32,843 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-24 12:29:32,843 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure a4dcc110f19379a2ecbc3912dd53fb48, server=jenkins-hbase6.apache.org,36595,1690201659396 in 229 msec 2023-07-24 12:29:32,845 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-24 12:29:32,845 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a4dcc110f19379a2ecbc3912dd53fb48, ASSIGN in 395 msec 2023-07-24 12:29:32,846 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 12:29:32,846 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201772846"}]},"ts":"1690201772846"} 2023-07-24 12:29:32,847 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-24 12:29:32,850 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 12:29:32,850 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-24 12:29:32,852 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36595] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 12:29:32,854 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:32,854 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:32,854 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:32,854 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:32,856 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 12:29:32,856 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 12:29:32,856 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 12:29:32,856 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 12:29:32,859 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 522 msec 2023-07-24 12:29:32,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 12:29:32,944 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-24 12:29:32,947 DEBUG [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:32,948 DEBUG [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48. 2023-07-24 12:29:32,950 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 12:29:32,970 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1583): Client=jenkins//172.31.2.20 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 12:29:32,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690201772970 (current time:1690201772970). 2023-07-24 12:29:32,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 12:29:32,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(139): Connect 0x656ce3e0 to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:29:32,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@420bb57f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:29:32,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:29:32,994 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:42204, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:29:32,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x656ce3e0 to 127.0.0.1:49553 2023-07-24 12:29:32,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:29:32,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(139): Connect 0x1e332871 to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:29:33,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c42bbb4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:29:33,004 DEBUG [hconnection-0x37d550e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:29:33,007 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:42214, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:29:33,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:29:33,014 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:45970, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:29:33,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e332871 to 127.0.0.1:49553 2023-07-24 12:29:33,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:29:33,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 12:29:33,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 12:29:33,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 12:29:33,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 12:29:33,020 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 12:29:33,021 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690202373021 2023-07-24 12:29:33,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 12:29:33,022 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,023 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 12:29:33,023 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 12:29:33,024 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 12:29:33,025 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 12:29:33,029 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 7 msec 2023-07-24 12:29:33,030 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 12:29:33,031 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690202373031 2023-07-24 12:29:33,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,044 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-24 12:29:33,044 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:29:33,050 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-24 12:29:33,050 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-24 12:29:33,051 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,051 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,052 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:33,052 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:33,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:33,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:33,052 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:33,053 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:33,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:33,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:33,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:33,053 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,053 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,054 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,054 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,054 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,054 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,054 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 12:29:33,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 12:29:33,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,055 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 12:29:33,055 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,055 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 12:29:33,055 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:29:33,058 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 12:29:33,058 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 12:29:33,058 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44275,1690201659331' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 12:29:33,064 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 12:29:33,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:29:33,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:29:33,065 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 12:29:33,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 12:29:33,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,065 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,065 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 12:29:33,065 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,065 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,066 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:29:33,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:29:33,066 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 12:29:33,066 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:29:33,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:29:33,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:29:33,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,44275,1690201659331' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 12:29:33,067 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b447fff[Count = 1] remaining members to acquire global barrier 2023-07-24 12:29:33,076 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 12:29:33,076 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,076 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 12:29:33,076 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,36595,1690201659396' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 12:29:33,076 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 12:29:33,076 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:29:33,078 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 12:29:33,078 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 12:29:33,078 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44517,1690201659253' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 12:29:33,081 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,081 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,081 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:29:33,081 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,082 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,082 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:29:33,082 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:29:33,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:29:33,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:29:33,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:29:33,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:33,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:29:33,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,36595,1690201659396' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 12:29:33,097 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b447fff[Count = 0] remaining members to acquire global barrier 2023-07-24 12:29:33,097 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-24 12:29:33,097 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,100 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,100 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,100 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,101 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,101 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 12:29:33,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,101 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 12:29:33,101 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 12:29:33,101 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 12:29:33,101 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase6.apache.org,44517,1690201659253' in zk 2023-07-24 12:29:33,101 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,102 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 12:29:33,103 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 12:29:33,103 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 12:29:33,103 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 12:29:33,103 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 12:29:33,103 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48. 2023-07-24 12:29:33,104 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48. started... 2023-07-24 12:29:33,104 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 12:29:33,104 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:29:33,104 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a4dcc110f19379a2ecbc3912dd53fb48: 2023-07-24 12:29:33,104 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 12:29:33,109 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,109 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 12:29:33,109 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 12:29:33,109 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc. 2023-07-24 12:29:33,109 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc. started... 2023-07-24 12:29:33,112 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f375b79e815cb906c36591db42d20dcc: 2023-07-24 12:29:33,112 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,112 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 12:29:33,112 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 12:29:33,123 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:29:33,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 12:29:33,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:29:33,125 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 12:29:33,136 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48. completed. 2023-07-24 12:29:33,136 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48. 2023-07-24 12:29:33,136 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 12:29:33,136 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 12:29:33,136 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,136 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 12:29:33,136 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase6.apache.org,36595,1690201659396' in zk 2023-07-24 12:29:33,137 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc. completed. 2023-07-24 12:29:33,137 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc. 2023-07-24 12:29:33,138 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 12:29:33,138 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 12:29:33,138 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,138 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 12:29:33,138 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase6.apache.org,44275,1690201659331' in zk 2023-07-24 12:29:33,138 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 12:29:33,138 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:29:33,138 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 12:29:33,141 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:29:33,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:29:33,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:29:33,142 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 12:29:33,142 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,142 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:29:33,142 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 12:29:33,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:29:33,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:33,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:29:33,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:33,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase6.apache.org,36595,1690201659396': 2023-07-24 12:29:33,148 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,36595,1690201659396' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-24 12:29:33,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:29:33,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:29:33,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:29:33,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:29:33,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:33,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:29:33,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:33,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase6.apache.org,44275,1690201659331': 2023-07-24 12:29:33,151 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,44275,1690201659331' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-24 12:29:33,151 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-24 12:29:33,151 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 12:29:33,151 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 12:29:33,151 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,151 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 12:29:33,153 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,153 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:29:33,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:29:33,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,153 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:33,153 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,153 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,154 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:33,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:29:33,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,154 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,154 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:33,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:33,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:33,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:33,154 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:33,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:33,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:29:33,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:33,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:33,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,155 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:33,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:29:33,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,157 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,157 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:33,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:33,158 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,161 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,161 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,161 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:33,162 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:33,162 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:33,162 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:33,162 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:33,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:33,162 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:33,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:33,162 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:29:33,162 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:33,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:33,162 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:33,162 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:33,164 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,162 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:33,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:33,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:33,164 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,162 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,164 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:33,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:33,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:33,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:33,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 12:29:33,164 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,164 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,164 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:33,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 12:29:33,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,189 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,325 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:29:33,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 12:29:33,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:29:33,327 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 12:29:33,336 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-24 12:29:33,336 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,337 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,337 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690201773022Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1690201773188 (+166 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690201773188Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690201773188Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690201773193 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690201773254 (+61 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690201773336 (+82 ms) 2023-07-24 12:29:33,340 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 12:29:33,342 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 317 msec 2023-07-24 12:29:33,627 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:29:33,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 12:29:33,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 12:29:33,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36595] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 12:29:33,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44275] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 12:29:33,636 DEBUG [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,637 DEBUG [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48. 2023-07-24 12:29:33,637 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 12:29:33,646 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1583): Client=jenkins//172.31.2.20 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 12:29:33,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690201773646 (current time:1690201773646). 2023-07-24 12:29:33,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 12:29:33,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(139): Connect 0x0a0c8d55 to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:29:33,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63b07c3f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:29:33,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:29:33,659 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:42228, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:29:33,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a0c8d55 to 127.0.0.1:49553 2023-07-24 12:29:33,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:29:33,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(139): Connect 0x5a7cb41a to 127.0.0.1:49553 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 12:29:33,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3474fc25, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 12:29:33,668 DEBUG [hconnection-0x54c52f10-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:29:33,671 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:42242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:29:33,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 12:29:33,678 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.20:45972, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 12:29:33,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5a7cb41a to 127.0.0.1:49553 2023-07-24 12:29:33,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:29:33,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 12:29:33,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 12:29:33,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 12:29:33,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 12:29:33,684 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 12:29:33,684 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690202373684 2023-07-24 12:29:33,685 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 12:29:33,686 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 12:29:33,686 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 12:29:33,686 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 12:29:33,688 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 12:29:33,691 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-24 12:29:33,691 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 12:29:33,692 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690202373692 2023-07-24 12:29:33,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,718 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-24 12:29:33,718 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:29:33,719 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-24 12:29:33,720 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-24 12:29:33,787 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:29:33,787 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,787 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 12:29:33,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:29:33,788 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 12:29:33,789 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:33,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:33,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:33,789 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:33,789 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:33,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:33,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:33,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:33,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:33,790 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,791 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,791 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,791 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 12:29:33,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,791 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 12:29:33,792 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,792 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 12:29:33,792 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:29:33,792 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 12:29:33,793 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 12:29:33,793 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 12:29:33,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,793 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 12:29:33,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 12:29:33,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,793 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,36595,1690201659396' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 12:29:33,794 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 12:29:33,794 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 12:29:33,794 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,794 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,794 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 12:29:33,794 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 12:29:33,794 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:29:33,794 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 12:29:33,795 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 12:29:33,797 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 12:29:33,797 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 12:29:33,797 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 12:29:33,797 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44275,1690201659331' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 12:29:33,797 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,797 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:29:33,797 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase6.apache.org,44517,1690201659253' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 12:29:33,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:29:33,797 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,797 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:29:33,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:29:33,798 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,798 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:29:33,802 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,802 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,802 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:29:33,802 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,802 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 12:29:33,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:33,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:29:33,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,36595,1690201659396' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 12:29:33,804 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c9fd321[Count = 1] remaining members to acquire global barrier 2023-07-24 12:29:33,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:29:33,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:29:33,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:29:33,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:29:33,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:33,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:29:33,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase6.apache.org,44275,1690201659331' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 12:29:33,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c9fd321[Count = 0] remaining members to acquire global barrier 2023-07-24 12:29:33,806 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-24 12:29:33,806 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,813 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,813 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,813 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,813 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 12:29:33,813 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 12:29:33,813 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 12:29:33,813 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase6.apache.org,44517,1690201659253' in zk 2023-07-24 12:29:33,813 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 12:29:33,813 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 12:29:33,813 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc. 2023-07-24 12:29:33,814 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc. started... 2023-07-24 12:29:33,814 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,814 INFO [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f375b79e815cb906c36591db42d20dcc 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-24 12:29:33,814 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,814 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 12:29:33,815 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 12:29:33,815 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:29:33,815 DEBUG [member: 'jenkins-hbase6.apache.org,44517,1690201659253' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 12:29:33,818 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,818 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 12:29:33,818 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 12:29:33,818 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 12:29:33,818 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48. 2023-07-24 12:29:33,818 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48. started... 2023-07-24 12:29:33,819 INFO [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a4dcc110f19379a2ecbc3912dd53fb48 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-24 12:29:33,842 INFO [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307248984f570d97c486885e1af4034138e6b to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307248984f570d97c486885e1af4034138e6b 2023-07-24 12:29:33,855 INFO [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithSkipTmp/f375b79e815cb906c36591db42d20dcc/.tmp/cf/b70911f7f9b84e88b689013bc732eb12 2023-07-24 12:29:33,863 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithSkipTmp/f375b79e815cb906c36591db42d20dcc/.tmp/cf/b70911f7f9b84e88b689013bc732eb12 as hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithSkipTmp/f375b79e815cb906c36591db42d20dcc/cf/b70911f7f9b84e88b689013bc732eb12 2023-07-24 12:29:33,868 INFO [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithSkipTmp/f375b79e815cb906c36591db42d20dcc/cf/b70911f7f9b84e88b689013bc732eb12, entries=45, sequenceid=6, filesize=13.0 K 2023-07-24 12:29:33,869 INFO [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for f375b79e815cb906c36591db42d20dcc in 55ms, sequenceid=6, compaction requested=false 2023-07-24 12:29:33,869 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-24 12:29:33,870 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f375b79e815cb906c36591db42d20dcc: 2023-07-24 12:29:33,870 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,870 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 12:29:33,870 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithSkipTmp/f375b79e815cb906c36591db42d20dcc/cf/b70911f7f9b84e88b689013bc732eb12] hfiles 2023-07-24 12:29:33,870 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithSkipTmp/f375b79e815cb906c36591db42d20dcc/cf/b70911f7f9b84e88b689013bc732eb12 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,879 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc. completed. 2023-07-24 12:29:33,879 DEBUG [rs(jenkins-hbase6.apache.org,44275,1690201659331)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc. 2023-07-24 12:29:33,879 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 12:29:33,879 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 12:29:33,879 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,879 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 12:29:33,879 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase6.apache.org,44275,1690201659331' in zk 2023-07-24 12:29:33,881 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,881 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 12:29:33,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:29:33,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:29:33,881 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:29:33,882 DEBUG [member: 'jenkins-hbase6.apache.org,44275,1690201659331' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 12:29:33,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:29:33,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:29:33,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:33,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:33,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:29:33,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:33,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:33,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:33,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase6.apache.org,44275,1690201659331': 2023-07-24 12:29:33,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,44275,1690201659331' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-24 12:29:33,988 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:29:33,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 12:29:33,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:29:33,990 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 12:29:34,240 INFO [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307240882a858aee1403a820a5f0534f5d13a to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307240882a858aee1403a820a5f0534f5d13a 2023-07-24 12:29:34,252 INFO [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithSkipTmp/a4dcc110f19379a2ecbc3912dd53fb48/.tmp/cf/a3eec1629676484bb25490a0818f03b3 2023-07-24 12:29:34,257 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithSkipTmp/a4dcc110f19379a2ecbc3912dd53fb48/.tmp/cf/a3eec1629676484bb25490a0818f03b3 as hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithSkipTmp/a4dcc110f19379a2ecbc3912dd53fb48/cf/a3eec1629676484bb25490a0818f03b3 2023-07-24 12:29:34,263 INFO [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithSkipTmp/a4dcc110f19379a2ecbc3912dd53fb48/cf/a3eec1629676484bb25490a0818f03b3, entries=5, sequenceid=6, filesize=5.8 K 2023-07-24 12:29:34,264 INFO [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for a4dcc110f19379a2ecbc3912dd53fb48 in 445ms, sequenceid=6, compaction requested=false 2023-07-24 12:29:34,266 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a4dcc110f19379a2ecbc3912dd53fb48: 2023-07-24 12:29:34,266 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,266 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 12:29:34,266 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithSkipTmp/a4dcc110f19379a2ecbc3912dd53fb48/cf/a3eec1629676484bb25490a0818f03b3] hfiles 2023-07-24 12:29:34,266 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithSkipTmp/a4dcc110f19379a2ecbc3912dd53fb48/cf/a3eec1629676484bb25490a0818f03b3 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,290 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:29:34,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 12:29:34,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:29:34,291 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 12:29:34,306 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48. completed. 2023-07-24 12:29:34,306 DEBUG [rs(jenkins-hbase6.apache.org,36595,1690201659396)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48. 2023-07-24 12:29:34,306 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 12:29:34,306 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 12:29:34,306 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:34,306 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 12:29:34,306 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase6.apache.org,36595,1690201659396' in zk 2023-07-24 12:29:34,309 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:34,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:34,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:29:34,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:29:34,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:29:34,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:29:34,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:34,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:34,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:34,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:29:34,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:34,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:34,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:34,316 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 12:29:34,316 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:29:34,316 DEBUG [member: 'jenkins-hbase6.apache.org,36595,1690201659396' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 12:29:34,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase6.apache.org,36595,1690201659396': 2023-07-24 12:29:34,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase6.apache.org,36595,1690201659396' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-24 12:29:34,319 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-24 12:29:34,319 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 12:29:34,319 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 12:29:34,319 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,319 INFO [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 12:29:34,322 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,322 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,322 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:34,322 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,322 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:34,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 12:29:34,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 12:29:34,322 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,322 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:34,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:34,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:34,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 12:29:34,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:34,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:34,323 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:34,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:34,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:34,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,324 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:34,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 12:29:34,324 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:34,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:34,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:34,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:34,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 12:29:34,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:34,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:34,327 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:34,328 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:34,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:34,328 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:34,332 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:34,332 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:34,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:34,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:34,332 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:34,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:34,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:34,332 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:34,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:34,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:34,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:34,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:34,333 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:34,333 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,333 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 12:29:34,333 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 12:29:34,333 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:34,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 12:29:34,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 12:29:34,333 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:34,334 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,334 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:34,334 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,334 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:29:34,334 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:34,334 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,334 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 12:29:34,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 12:29:34,334 DEBUG [(jenkins-hbase6.apache.org,38215,1690201657817)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 12:29:34,334 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,340 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 12:29:34,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307248984f570d97c486885e1af4034138e6b, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307240882a858aee1403a820a5f0534f5d13a] mob files 2023-07-24 12:29:34,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307248984f570d97c486885e1af4034138e6b 2023-07-24 12:29:34,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307240882a858aee1403a820a5f0534f5d13a 2023-07-24 12:29:34,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:34,792 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:29:34,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 12:29:34,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 12:29:34,794 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-24 12:29:34,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:35,322 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-24 12:29:35,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:35,323 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:35,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase6:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690201773685Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1690201774371 (+686 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690201774371Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1690201774372 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1690201774399 (+27 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690201774840 (+441 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690201775322 (+482 ms) 2023-07-24 12:29:35,327 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 12:29:35,328 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 1.6410 sec 2023-07-24 12:29:35,794 DEBUG [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 12:29:35,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 12:29:35,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 12:29:35,795 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201775795 2023-07-24 12:29:35,795 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42387, tgtDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201775795, rawTgtDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201775795, srcFsUri=hdfs://localhost:42387, srcDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa 2023-07-24 12:29:35,823 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42387, inputRoot=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa 2023-07-24 12:29:35,823 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_632677575_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201775795, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201775795/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:35,823 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42387, inputRoot=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa, snapshotDir=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-24 12:29:35,847 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201775795/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:35,901 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:35,902 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:35,902 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:35,902 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:35,903 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:35,903 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:35,904 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:35,984 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/hadoop-4113720578663404701.jar 2023-07-24 12:29:35,985 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:35,985 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:35,986 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:35,986 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:35,986 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:35,987 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 12:29:35,987 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 12:29:35,988 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 12:29:35,988 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 12:29:35,989 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 12:29:35,989 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 12:29:35,989 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 12:29:35,990 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 12:29:35,990 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 12:29:35,991 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 12:29:35,991 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 12:29:35,992 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:29:35,992 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:29:35,993 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 12:29:35,993 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:29:35,993 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 12:29:35,994 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 12:29:35,994 DEBUG [Listener at jenkins-hbase6.apache.org/41373] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 12:29:36,558 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0006_000001 (auth:SIMPLE) 2023-07-24 12:29:37,001 WARN [Listener at jenkins-hbase6.apache.org/41373] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 12:29:37,004 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-24 12:29:37,010 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-24 12:29:37,141 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 12:29:37,141 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 12:29:37,259 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0007_000001 (auth:SIMPLE) 2023-07-24 12:29:37,680 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 12:29:42,683 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0007_000001 (auth:SIMPLE) 2023-07-24 12:29:44,943 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0007_000001 (auth:SIMPLE) 2023-07-24 12:29:48,799 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690201666984_0007_000001 (auth:SIMPLE) 2023-07-24 12:29:50,491 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 12:29:50,491 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 12:29:50,510 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:50,510 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 12:29:50,511 INFO [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 12:29:50,511 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1338397176_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:50,511 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-24 12:29:50,512 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-24 12:29:50,512 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1338397176_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201775795/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201775795/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:50,512 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201775795/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-24 12:29:50,512 DEBUG [Listener at jenkins-hbase6.apache.org/41373] snapshot.TestExportSnapshot(367): hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/export-test/export-1690201775795/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-24 12:29:50,518 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:50,519 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.HMaster$11(2418): Client=jenkins//172.31.2.20 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:50,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:50,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 12:29:50,524 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201790524"}]},"ts":"1690201790524"} 2023-07-24 12:29:50,525 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-24 12:29:50,527 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-24 12:29:50,527 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a4dcc110f19379a2ecbc3912dd53fb48, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f375b79e815cb906c36591db42d20dcc, UNASSIGN}] 2023-07-24 12:29:50,529 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a4dcc110f19379a2ecbc3912dd53fb48, UNASSIGN 2023-07-24 12:29:50,530 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f375b79e815cb906c36591db42d20dcc, UNASSIGN 2023-07-24 12:29:50,530 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=a4dcc110f19379a2ecbc3912dd53fb48, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:29:50,530 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=f375b79e815cb906c36591db42d20dcc, regionState=CLOSING, regionLocation=jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:29:50,530 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690201790530"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201790530"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201790530"}]},"ts":"1690201790530"} 2023-07-24 12:29:50,530 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690201790530"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690201790530"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690201790530"}]},"ts":"1690201790530"} 2023-07-24 12:29:50,532 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure a4dcc110f19379a2ecbc3912dd53fb48, server=jenkins-hbase6.apache.org,36595,1690201659396}] 2023-07-24 12:29:50,534 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure f375b79e815cb906c36591db42d20dcc, server=jenkins-hbase6.apache.org,44275,1690201659331}] 2023-07-24 12:29:50,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 12:29:50,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(111): Close a4dcc110f19379a2ecbc3912dd53fb48 2023-07-24 12:29:50,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(111): Close f375b79e815cb906c36591db42d20dcc 2023-07-24 12:29:50,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing a4dcc110f19379a2ecbc3912dd53fb48, disabling compactions & flushes 2023-07-24 12:29:50,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing f375b79e815cb906c36591db42d20dcc, disabling compactions & flushes 2023-07-24 12:29:50,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48. 2023-07-24 12:29:50,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc. 2023-07-24 12:29:50,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48. 2023-07-24 12:29:50,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc. 2023-07-24 12:29:50,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48. after waiting 0 ms 2023-07-24 12:29:50,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc. after waiting 0 ms 2023-07-24 12:29:50,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48. 2023-07-24 12:29:50,687 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc. 2023-07-24 12:29:50,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithSkipTmp/a4dcc110f19379a2ecbc3912dd53fb48/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 12:29:50,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/default/testtb-testExportFileSystemStateWithSkipTmp/f375b79e815cb906c36591db42d20dcc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 12:29:50,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 12:29:50,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 12:29:50,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48. 2023-07-24 12:29:50,699 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc. 2023-07-24 12:29:50,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for a4dcc110f19379a2ecbc3912dd53fb48: 2023-07-24 12:29:50,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for f375b79e815cb906c36591db42d20dcc: 2023-07-24 12:29:50,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(149): Closed f375b79e815cb906c36591db42d20dcc 2023-07-24 12:29:50,702 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=f375b79e815cb906c36591db42d20dcc, regionState=CLOSED 2023-07-24 12:29:50,702 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690201790702"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201790702"}]},"ts":"1690201790702"} 2023-07-24 12:29:50,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.UnassignRegionHandler(149): Closed a4dcc110f19379a2ecbc3912dd53fb48 2023-07-24 12:29:50,703 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=a4dcc110f19379a2ecbc3912dd53fb48, regionState=CLOSED 2023-07-24 12:29:50,703 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690201790703"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690201790703"}]},"ts":"1690201790703"} 2023-07-24 12:29:50,706 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-24 12:29:50,706 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure f375b79e815cb906c36591db42d20dcc, server=jenkins-hbase6.apache.org,44275,1690201659331 in 170 msec 2023-07-24 12:29:50,707 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f375b79e815cb906c36591db42d20dcc, UNASSIGN in 179 msec 2023-07-24 12:29:50,707 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-24 12:29:50,707 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure a4dcc110f19379a2ecbc3912dd53fb48, server=jenkins-hbase6.apache.org,36595,1690201659396 in 173 msec 2023-07-24 12:29:50,709 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-24 12:29:50,709 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a4dcc110f19379a2ecbc3912dd53fb48, UNASSIGN in 180 msec 2023-07-24 12:29:50,709 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690201790709"}]},"ts":"1690201790709"} 2023-07-24 12:29:50,710 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-24 12:29:50,713 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-24 12:29:50,715 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 195 msec 2023-07-24 12:29:50,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 12:29:50,825 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-24 12:29:50,826 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.HMaster$5(2228): Client=jenkins//172.31.2.20 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:50,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:50,829 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:50,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:50,830 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:50,832 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36595] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:50,834 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a4dcc110f19379a2ecbc3912dd53fb48 2023-07-24 12:29:50,834 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:50,834 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:50,834 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:50,834 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:50,835 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 12:29:50,835 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 12:29:50,835 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 12:29:50,835 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 12:29:50,835 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f375b79e815cb906c36591db42d20dcc 2023-07-24 12:29:50,836 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:50,836 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:50,836 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:50,836 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:50,836 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:50,836 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:50,836 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:50,836 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 12:29:50,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-24 12:29:50,837 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a4dcc110f19379a2ecbc3912dd53fb48/cf, FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a4dcc110f19379a2ecbc3912dd53fb48/recovered.edits] 2023-07-24 12:29:50,838 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f375b79e815cb906c36591db42d20dcc/cf, FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f375b79e815cb906c36591db42d20dcc/recovered.edits] 2023-07-24 12:29:50,843 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f375b79e815cb906c36591db42d20dcc/cf/b70911f7f9b84e88b689013bc732eb12 to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/f375b79e815cb906c36591db42d20dcc/cf/b70911f7f9b84e88b689013bc732eb12 2023-07-24 12:29:50,843 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a4dcc110f19379a2ecbc3912dd53fb48/cf/a3eec1629676484bb25490a0818f03b3 to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a4dcc110f19379a2ecbc3912dd53fb48/cf/a3eec1629676484bb25490a0818f03b3 2023-07-24 12:29:50,862 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f375b79e815cb906c36591db42d20dcc/recovered.edits/9.seqid to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/f375b79e815cb906c36591db42d20dcc/recovered.edits/9.seqid 2023-07-24 12:29:50,862 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a4dcc110f19379a2ecbc3912dd53fb48/recovered.edits/9.seqid to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a4dcc110f19379a2ecbc3912dd53fb48/recovered.edits/9.seqid 2023-07-24 12:29:50,862 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f375b79e815cb906c36591db42d20dcc 2023-07-24 12:29:50,863 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a4dcc110f19379a2ecbc3912dd53fb48 2023-07-24 12:29:50,863 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-24 12:29:50,863 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-24 12:29:50,864 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-24 12:29:50,867 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307248984f570d97c486885e1af4034138e6b to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307248984f570d97c486885e1af4034138e6b 2023-07-24 12:29:50,869 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307240882a858aee1403a820a5f0534f5d13a to hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307240882a858aee1403a820a5f0534f5d13a 2023-07-24 12:29:50,869 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-24 12:29:50,872 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:50,877 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-24 12:29:50,883 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-24 12:29:50,886 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:50,886 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-24 12:29:50,886 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690201790886"}]},"ts":"9223372036854775807"} 2023-07-24 12:29:50,886 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690201790886"}]},"ts":"9223372036854775807"} 2023-07-24 12:29:50,889 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 12:29:50,889 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a4dcc110f19379a2ecbc3912dd53fb48, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690201772334.a4dcc110f19379a2ecbc3912dd53fb48.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f375b79e815cb906c36591db42d20dcc, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690201772334.f375b79e815cb906c36591db42d20dcc.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 12:29:50,889 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-24 12:29:50,889 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690201790889"}]},"ts":"9223372036854775807"} 2023-07-24 12:29:50,908 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-24 12:29:50,911 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:50,912 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 85 msec 2023-07-24 12:29:50,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-24 12:29:50,939 INFO [Listener at jenkins-hbase6.apache.org/41373] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-24 12:29:50,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(751): Client=jenkins//172.31.2.20 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-24 12:29:50,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:50,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] master.MasterRpcServices(751): Client=jenkins//172.31.2.20 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-24 12:29:50,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38215] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 12:29:50,995 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764 (was 762) Potentially hanging thread: IPC Client (583231684) connection to jenkins-hbase6.apache.org/172.31.2.20:44337 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x4f8b35dd-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1613280175_1 at /127.0.0.1:50124 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4f8b35dd-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1338397176_17 at /127.0.0.1:37780 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x4f8b35dd-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1613280175_1 at /127.0.0.1:48862 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1338397176_17 at /127.0.0.1:48866 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5547 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x4f8b35dd-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1338397176_17 at /127.0.0.1:50142 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase6:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=905 (was 925), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=575 (was 583), ProcessCount=176 (was 176), AvailableMemoryMB=1617 (was 899) - AvailableMemoryMB LEAK? - 2023-07-24 12:29:50,995 WARN [Listener at jenkins-hbase6.apache.org/41373] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-24 12:29:50,995 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-24 12:29:51,020 INFO [Listener at jenkins-hbase6.apache.org/41373] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase6.apache.org:0 2023-07-24 12:29:51,135 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1690201666984_0007_01_000001 is : 143 2023-07-24 12:29:56,277 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 12:30:05,147 INFO [Listener at jenkins-hbase6.apache.org/41373] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase6.apache.org:0 2023-07-24 12:30:19,273 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 12:30:19,273 INFO [Listener at jenkins-hbase6.apache.org/41373] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase6.apache.org:0 2023-07-24 12:30:19,398 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-24 12:30:19,410 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-24 12:30:19,411 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 12:30:19,430 INFO [Listener at jenkins-hbase6.apache.org/41373] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase6.apache.org:0 2023-07-24 12:30:19,535 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 12:30:19,536 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-24 12:30:19,536 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-24 12:30:19,536 INFO [Listener at jenkins-hbase6.apache.org/41373] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-24 12:30:19,536 DEBUG [Listener at jenkins-hbase6.apache.org/41373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71d6bc92 to 127.0.0.1:49553 2023-07-24 12:30:19,536 DEBUG [Listener at jenkins-hbase6.apache.org/41373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:30:19,536 DEBUG [Listener at jenkins-hbase6.apache.org/41373] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-24 12:30:19,536 DEBUG [Listener at jenkins-hbase6.apache.org/41373] util.JVMClusterUtil(257): Found active master hash=1949797975, stopped=false 2023-07-24 12:30:19,537 DEBUG [Listener at jenkins-hbase6.apache.org/41373] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 12:30:19,537 DEBUG [Listener at jenkins-hbase6.apache.org/41373] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 12:30:19,537 INFO [Listener at jenkins-hbase6.apache.org/41373] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase6.apache.org,38215,1690201657817 2023-07-24 12:30:19,541 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 12:30:19,541 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 12:30:19,541 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 12:30:19,542 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 12:30:19,542 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 12:30:19,542 INFO [Listener at jenkins-hbase6.apache.org/41373] procedure2.ProcedureExecutor(629): Stopping 2023-07-24 12:30:19,542 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 12:30:19,542 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 12:30:19,542 DEBUG [Listener at jenkins-hbase6.apache.org/41373] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x189f9632 to 127.0.0.1:49553 2023-07-24 12:30:19,542 DEBUG [Listener at jenkins-hbase6.apache.org/41373] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:30:19,542 INFO [Listener at jenkins-hbase6.apache.org/41373] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase6.apache.org,44517,1690201659253' ***** 2023-07-24 12:30:19,543 DEBUG [Listener at jenkins-hbase6.apache.org/41373] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 12:30:19,543 INFO [Listener at jenkins-hbase6.apache.org/41373] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 12:30:19,543 INFO [Listener at jenkins-hbase6.apache.org/41373] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase6.apache.org,44275,1690201659331' ***** 2023-07-24 12:30:19,543 DEBUG [Listener at jenkins-hbase6.apache.org/41373] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 12:30:19,543 INFO [Listener at jenkins-hbase6.apache.org/41373] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 12:30:19,543 INFO [RS:0;jenkins-hbase6:44517] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 12:30:19,543 INFO [RS:1;jenkins-hbase6:44275] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 12:30:19,543 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 12:30:19,543 INFO [RS:0;jenkins-hbase6:44517] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 12:30:19,543 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 12:30:19,543 INFO [Listener at jenkins-hbase6.apache.org/41373] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase6.apache.org,36595,1690201659396' ***** 2023-07-24 12:30:19,543 INFO [RS:0;jenkins-hbase6:44517] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 12:30:19,544 INFO [RS:0;jenkins-hbase6:44517] regionserver.HRegionServer(1144): stopping server jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:30:19,544 DEBUG [RS:0;jenkins-hbase6:44517] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x599ea369 to 127.0.0.1:49553 2023-07-24 12:30:19,544 DEBUG [RS:0;jenkins-hbase6:44517] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:30:19,543 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 12:30:19,543 INFO [RS:1;jenkins-hbase6:44275] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 12:30:19,548 INFO [RS:1;jenkins-hbase6:44275] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 12:30:19,548 INFO [RS:1;jenkins-hbase6:44275] regionserver.HRegionServer(1144): stopping server jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:30:19,548 DEBUG [RS:1;jenkins-hbase6:44275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25160707 to 127.0.0.1:49553 2023-07-24 12:30:19,548 DEBUG [RS:1;jenkins-hbase6:44275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:30:19,543 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 12:30:19,547 INFO [RS:0;jenkins-hbase6:44517] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 12:30:19,552 INFO [RS:1;jenkins-hbase6:44275] regionserver.HRegionServer(1170): stopping server jenkins-hbase6.apache.org,44275,1690201659331; all regions closed. 2023-07-24 12:30:19,544 DEBUG [Listener at jenkins-hbase6.apache.org/41373] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 12:30:19,552 INFO [RS:0;jenkins-hbase6:44517] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 12:30:19,552 INFO [Listener at jenkins-hbase6.apache.org/41373] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 12:30:19,552 INFO [RS:0;jenkins-hbase6:44517] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 12:30:19,552 INFO [RS:2;jenkins-hbase6:36595] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 12:30:19,552 INFO [RS:0;jenkins-hbase6:44517] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-24 12:30:19,552 INFO [RS:2;jenkins-hbase6:36595] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 12:30:19,553 INFO [RS:2;jenkins-hbase6:36595] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 12:30:19,553 INFO [RS:2;jenkins-hbase6:36595] regionserver.HRegionServer(3305): Received CLOSE for 17bddcd2885a71d9ecf0f33defdd86ee 2023-07-24 12:30:19,553 INFO [RS:2;jenkins-hbase6:36595] regionserver.HRegionServer(3305): Received CLOSE for 0157ff2227367fdf1e099de19af17c90 2023-07-24 12:30:19,553 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 12:30:19,553 INFO [RS:2;jenkins-hbase6:36595] regionserver.HRegionServer(1144): stopping server jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:30:19,553 DEBUG [RS:2;jenkins-hbase6:36595] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2a0eda72 to 127.0.0.1:49553 2023-07-24 12:30:19,553 DEBUG [RS:2;jenkins-hbase6:36595] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:30:19,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 17bddcd2885a71d9ecf0f33defdd86ee, disabling compactions & flushes 2023-07-24 12:30:19,571 INFO [RS:2;jenkins-hbase6:36595] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-24 12:30:19,571 DEBUG [RS:2;jenkins-hbase6:36595] regionserver.HRegionServer(1478): Online Regions={17bddcd2885a71d9ecf0f33defdd86ee=hbase:acl,,1690201662916.17bddcd2885a71d9ecf0f33defdd86ee., 0157ff2227367fdf1e099de19af17c90=hbase:namespace,,1690201662157.0157ff2227367fdf1e099de19af17c90.} 2023-07-24 12:30:19,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690201662916.17bddcd2885a71d9ecf0f33defdd86ee. 2023-07-24 12:30:19,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690201662916.17bddcd2885a71d9ecf0f33defdd86ee. 2023-07-24 12:30:19,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690201662916.17bddcd2885a71d9ecf0f33defdd86ee. after waiting 0 ms 2023-07-24 12:30:19,571 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690201662916.17bddcd2885a71d9ecf0f33defdd86ee. 2023-07-24 12:30:19,571 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2745): Flushing 17bddcd2885a71d9ecf0f33defdd86ee 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-24 12:30:19,572 DEBUG [RS:2;jenkins-hbase6:36595] regionserver.HRegionServer(1504): Waiting on 0157ff2227367fdf1e099de19af17c90, 17bddcd2885a71d9ecf0f33defdd86ee 2023-07-24 12:30:19,600 INFO [RS:0;jenkins-hbase6:44517] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-24 12:30:19,600 DEBUG [RS:0;jenkins-hbase6:44517] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-24 12:30:19,601 DEBUG [RS:0;jenkins-hbase6:44517] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-24 12:30:19,603 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-24 12:30:19,604 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-24 12:30:19,604 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-24 12:30:19,604 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-24 12:30:19,604 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-24 12:30:19,604 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-24 12:30:19,629 DEBUG [RS:1;jenkins-hbase6:44275] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/oldWALs 2023-07-24 12:30:19,629 INFO [RS:1;jenkins-hbase6:44275] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C44275%2C1690201659331:(num 1690201661588) 2023-07-24 12:30:19,629 DEBUG [RS:1;jenkins-hbase6:44275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:30:19,629 INFO [RS:1;jenkins-hbase6:44275] regionserver.LeaseManager(133): Closed leases 2023-07-24 12:30:19,629 INFO [RS:1;jenkins-hbase6:44275] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-24 12:30:19,630 INFO [RS:1;jenkins-hbase6:44275] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 12:30:19,630 INFO [RS:1;jenkins-hbase6:44275] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 12:30:19,630 INFO [RS:1;jenkins-hbase6:44275] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 12:30:19,630 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 12:30:19,630 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 12:30:19,630 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 12:30:19,631 INFO [RS:1;jenkins-hbase6:44275] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:44275 2023-07-24 12:30:19,637 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:30:19,637 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 12:30:19,637 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:30:19,637 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 12:30:19,637 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,44275,1690201659331 2023-07-24 12:30:19,637 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 12:30:19,637 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 12:30:19,639 INFO [regionserver/jenkins-hbase6:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 12:30:19,647 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,44275,1690201659331] 2023-07-24 12:30:19,648 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,44275,1690201659331; numProcessing=1 2023-07-24 12:30:19,650 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,44275,1690201659331 already deleted, retry=false 2023-07-24 12:30:19,651 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,44275,1690201659331 expired; onlineServers=2 2023-07-24 12:30:19,654 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/acl/17bddcd2885a71d9ecf0f33defdd86ee/.tmp/l/46b4c7b5aad841ec994b2a20f9496cf1 2023-07-24 12:30:19,659 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 46b4c7b5aad841ec994b2a20f9496cf1 2023-07-24 12:30:19,660 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740/.tmp/info/35fee6a8b4ec4f8280c24608a1b7bac6 2023-07-24 12:30:19,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/acl/17bddcd2885a71d9ecf0f33defdd86ee/.tmp/l/46b4c7b5aad841ec994b2a20f9496cf1 as hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/acl/17bddcd2885a71d9ecf0f33defdd86ee/l/46b4c7b5aad841ec994b2a20f9496cf1 2023-07-24 12:30:19,664 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 35fee6a8b4ec4f8280c24608a1b7bac6 2023-07-24 12:30:19,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 46b4c7b5aad841ec994b2a20f9496cf1 2023-07-24 12:30:19,665 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/acl/17bddcd2885a71d9ecf0f33defdd86ee/l/46b4c7b5aad841ec994b2a20f9496cf1, entries=7, sequenceid=18, filesize=5.2 K 2023-07-24 12:30:19,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 17bddcd2885a71d9ecf0f33defdd86ee in 95ms, sequenceid=18, compaction requested=false 2023-07-24 12:30:19,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/acl/17bddcd2885a71d9ecf0f33defdd86ee/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-24 12:30:19,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 12:30:19,676 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1690201662916.17bddcd2885a71d9ecf0f33defdd86ee. 2023-07-24 12:30:19,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 17bddcd2885a71d9ecf0f33defdd86ee: 2023-07-24 12:30:19,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1690201662916.17bddcd2885a71d9ecf0f33defdd86ee. 2023-07-24 12:30:19,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1604): Closing 0157ff2227367fdf1e099de19af17c90, disabling compactions & flushes 2023-07-24 12:30:19,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690201662157.0157ff2227367fdf1e099de19af17c90. 2023-07-24 12:30:19,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690201662157.0157ff2227367fdf1e099de19af17c90. 2023-07-24 12:30:19,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690201662157.0157ff2227367fdf1e099de19af17c90. after waiting 0 ms 2023-07-24 12:30:19,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690201662157.0157ff2227367fdf1e099de19af17c90. 2023-07-24 12:30:19,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2745): Flushing 0157ff2227367fdf1e099de19af17c90 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-24 12:30:19,679 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740/.tmp/rep_barrier/46a40ffc517d423c98a4b30a6fad38f2 2023-07-24 12:30:19,683 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 46a40ffc517d423c98a4b30a6fad38f2 2023-07-24 12:30:19,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/namespace/0157ff2227367fdf1e099de19af17c90/.tmp/info/a4c63f655dde49088d42d281c9c40613 2023-07-24 12:30:19,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/namespace/0157ff2227367fdf1e099de19af17c90/.tmp/info/a4c63f655dde49088d42d281c9c40613 as hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/namespace/0157ff2227367fdf1e099de19af17c90/info/a4c63f655dde49088d42d281c9c40613 2023-07-24 12:30:19,699 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740/.tmp/table/fcfc158bc3294a028b4658c4e15eacd8 2023-07-24 12:30:19,703 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fcfc158bc3294a028b4658c4e15eacd8 2023-07-24 12:30:19,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/namespace/0157ff2227367fdf1e099de19af17c90/info/a4c63f655dde49088d42d281c9c40613, entries=2, sequenceid=6, filesize=4.8 K 2023-07-24 12:30:19,704 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740/.tmp/info/35fee6a8b4ec4f8280c24608a1b7bac6 as hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740/info/35fee6a8b4ec4f8280c24608a1b7bac6 2023-07-24 12:30:19,705 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 0157ff2227367fdf1e099de19af17c90 in 28ms, sequenceid=6, compaction requested=false 2023-07-24 12:30:19,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/namespace/0157ff2227367fdf1e099de19af17c90/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 12:30:19,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 12:30:19,710 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690201662157.0157ff2227367fdf1e099de19af17c90. 2023-07-24 12:30:19,710 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 0157ff2227367fdf1e099de19af17c90: 2023-07-24 12:30:19,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690201662157.0157ff2227367fdf1e099de19af17c90. 2023-07-24 12:30:19,711 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 35fee6a8b4ec4f8280c24608a1b7bac6 2023-07-24 12:30:19,711 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740/info/35fee6a8b4ec4f8280c24608a1b7bac6, entries=48, sequenceid=131, filesize=10.3 K 2023-07-24 12:30:19,712 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740/.tmp/rep_barrier/46a40ffc517d423c98a4b30a6fad38f2 as hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740/rep_barrier/46a40ffc517d423c98a4b30a6fad38f2 2023-07-24 12:30:19,715 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 46a40ffc517d423c98a4b30a6fad38f2 2023-07-24 12:30:19,715 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740/rep_barrier/46a40ffc517d423c98a4b30a6fad38f2, entries=13, sequenceid=131, filesize=6.4 K 2023-07-24 12:30:19,716 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740/.tmp/table/fcfc158bc3294a028b4658c4e15eacd8 as hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740/table/fcfc158bc3294a028b4658c4e15eacd8 2023-07-24 12:30:19,720 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fcfc158bc3294a028b4658c4e15eacd8 2023-07-24 12:30:19,720 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HStore(1080): Added hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740/table/fcfc158bc3294a028b4658c4e15eacd8, entries=24, sequenceid=131, filesize=6.9 K 2023-07-24 12:30:19,721 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 117ms, sequenceid=131, compaction requested=false 2023-07-24 12:30:19,729 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-24 12:30:19,730 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 12:30:19,730 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 12:30:19,731 INFO [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-24 12:30:19,731 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-24 12:30:19,731 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase6:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-24 12:30:19,738 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 12:30:19,738 INFO [RS:1;jenkins-hbase6:44275] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase6.apache.org,44275,1690201659331; zookeeper connection closed. 2023-07-24 12:30:19,738 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44275-0x100bed88b280002, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 12:30:19,739 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@31d45f2e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@31d45f2e 2023-07-24 12:30:19,772 INFO [RS:2;jenkins-hbase6:36595] regionserver.HRegionServer(1170): stopping server jenkins-hbase6.apache.org,36595,1690201659396; all regions closed. 2023-07-24 12:30:19,788 DEBUG [RS:2;jenkins-hbase6:36595] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/oldWALs 2023-07-24 12:30:19,788 INFO [RS:2;jenkins-hbase6:36595] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C36595%2C1690201659396:(num 1690201661584) 2023-07-24 12:30:19,788 DEBUG [RS:2;jenkins-hbase6:36595] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:30:19,789 INFO [RS:2;jenkins-hbase6:36595] regionserver.LeaseManager(133): Closed leases 2023-07-24 12:30:19,789 INFO [RS:2;jenkins-hbase6:36595] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-24 12:30:19,790 INFO [RS:2;jenkins-hbase6:36595] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 12:30:19,790 INFO [RS:2;jenkins-hbase6:36595] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 12:30:19,790 INFO [RS:2;jenkins-hbase6:36595] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 12:30:19,790 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 12:30:19,791 INFO [RS:2;jenkins-hbase6:36595] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:36595 2023-07-24 12:30:19,793 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:30:19,793 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,36595,1690201659396 2023-07-24 12:30:19,793 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 12:30:19,793 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,36595,1690201659396] 2023-07-24 12:30:19,793 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,36595,1690201659396; numProcessing=2 2023-07-24 12:30:19,795 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,36595,1690201659396 already deleted, retry=false 2023-07-24 12:30:19,795 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,36595,1690201659396 expired; onlineServers=1 2023-07-24 12:30:19,801 INFO [RS:0;jenkins-hbase6:44517] regionserver.HRegionServer(1170): stopping server jenkins-hbase6.apache.org,44517,1690201659253; all regions closed. 2023-07-24 12:30:19,813 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/WALs/jenkins-hbase6.apache.org,44517,1690201659253/jenkins-hbase6.apache.org%2C44517%2C1690201659253.meta.1690201661825.meta not finished, retry = 0 2023-07-24 12:30:19,894 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 12:30:19,895 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:36595-0x100bed88b280003, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 12:30:19,895 INFO [RS:2;jenkins-hbase6:36595] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase6.apache.org,36595,1690201659396; zookeeper connection closed. 2023-07-24 12:30:19,907 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7764095] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7764095 2023-07-24 12:30:19,916 DEBUG [RS:0;jenkins-hbase6:44517] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/oldWALs 2023-07-24 12:30:19,916 INFO [RS:0;jenkins-hbase6:44517] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C44517%2C1690201659253.meta:.meta(num 1690201661825) 2023-07-24 12:30:19,924 DEBUG [RS:0;jenkins-hbase6:44517] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/oldWALs 2023-07-24 12:30:19,924 INFO [RS:0;jenkins-hbase6:44517] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase6.apache.org%2C44517%2C1690201659253:(num 1690201661560) 2023-07-24 12:30:19,924 DEBUG [RS:0;jenkins-hbase6:44517] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:30:19,924 INFO [RS:0;jenkins-hbase6:44517] regionserver.LeaseManager(133): Closed leases 2023-07-24 12:30:19,924 INFO [RS:0;jenkins-hbase6:44517] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase6:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-24 12:30:19,925 INFO [regionserver/jenkins-hbase6:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 12:30:19,926 INFO [RS:0;jenkins-hbase6:44517] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:44517 2023-07-24 12:30:19,929 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase6.apache.org,44517,1690201659253 2023-07-24 12:30:19,929 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 12:30:19,930 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase6.apache.org,44517,1690201659253] 2023-07-24 12:30:19,930 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase6.apache.org,44517,1690201659253; numProcessing=3 2023-07-24 12:30:19,931 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase6.apache.org,44517,1690201659253 already deleted, retry=false 2023-07-24 12:30:19,931 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase6.apache.org,44517,1690201659253 expired; onlineServers=0 2023-07-24 12:30:19,931 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase6.apache.org,38215,1690201657817' ***** 2023-07-24 12:30:19,931 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-24 12:30:19,931 DEBUG [M:0;jenkins-hbase6:38215] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@350a846c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase6.apache.org/172.31.2.20:0 2023-07-24 12:30:19,931 INFO [M:0;jenkins-hbase6:38215] regionserver.HRegionServer(1144): stopping server jenkins-hbase6.apache.org,38215,1690201657817 2023-07-24 12:30:19,931 INFO [M:0;jenkins-hbase6:38215] regionserver.HRegionServer(1170): stopping server jenkins-hbase6.apache.org,38215,1690201657817; all regions closed. 2023-07-24 12:30:19,931 DEBUG [M:0;jenkins-hbase6:38215] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 12:30:19,931 DEBUG [M:0;jenkins-hbase6:38215] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-24 12:30:19,931 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-24 12:30:19,931 DEBUG [M:0;jenkins-hbase6:38215] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-24 12:30:19,931 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1690201661016] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.small.0-1690201661016,5,FailOnTimeoutGroup] 2023-07-24 12:30:19,932 INFO [M:0;jenkins-hbase6:38215] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-24 12:30:19,931 DEBUG [master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1690201661009] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase6:0:becomeActiveMaster-HFileCleaner.large.0-1690201661009,5,FailOnTimeoutGroup] 2023-07-24 12:30:19,932 INFO [M:0;jenkins-hbase6:38215] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-24 12:30:19,932 INFO [M:0;jenkins-hbase6:38215] hbase.ChoreService(369): Chore service for: master/jenkins-hbase6:0 had [] on shutdown 2023-07-24 12:30:19,932 DEBUG [M:0;jenkins-hbase6:38215] master.HMaster(1512): Stopping service threads 2023-07-24 12:30:19,932 INFO [M:0;jenkins-hbase6:38215] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-24 12:30:19,932 ERROR [M:0;jenkins-hbase6:38215] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-24 12:30:19,932 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-24 12:30:19,932 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 12:30:19,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 12:30:19,933 INFO [M:0;jenkins-hbase6:38215] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-24 12:30:19,933 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-24 12:30:19,933 DEBUG [M:0;jenkins-hbase6:38215] zookeeper.ZKUtil(398): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-24 12:30:19,933 WARN [M:0;jenkins-hbase6:38215] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-24 12:30:19,933 INFO [M:0;jenkins-hbase6:38215] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-24 12:30:19,934 INFO [M:0;jenkins-hbase6:38215] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-24 12:30:19,934 DEBUG [M:0;jenkins-hbase6:38215] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-24 12:30:19,934 INFO [M:0;jenkins-hbase6:38215] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 12:30:19,934 DEBUG [M:0;jenkins-hbase6:38215] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 12:30:19,934 DEBUG [M:0;jenkins-hbase6:38215] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-24 12:30:19,934 DEBUG [M:0;jenkins-hbase6:38215] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 12:30:19,934 INFO [M:0;jenkins-hbase6:38215] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.65 KB heapSize=451.96 KB 2023-07-24 12:30:19,949 INFO [M:0;jenkins-hbase6:38215] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.65 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3ceef020aa094236bb6d6b4be7231e40 2023-07-24 12:30:19,953 INFO [M:0;jenkins-hbase6:38215] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3ceef020aa094236bb6d6b4be7231e40 2023-07-24 12:30:19,954 DEBUG [M:0;jenkins-hbase6:38215] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3ceef020aa094236bb6d6b4be7231e40 as hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3ceef020aa094236bb6d6b4be7231e40 2023-07-24 12:30:19,958 INFO [M:0;jenkins-hbase6:38215] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3ceef020aa094236bb6d6b4be7231e40 2023-07-24 12:30:19,959 INFO [M:0;jenkins-hbase6:38215] regionserver.HStore(1080): Added hdfs://localhost:42387/user/jenkins/test-data/f73e83dc-589f-2511-0219-4e4e2f68dbaa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3ceef020aa094236bb6d6b4be7231e40, entries=119, sequenceid=899, filesize=28.6 K 2023-07-24 12:30:19,959 INFO [M:0;jenkins-hbase6:38215] regionserver.HRegion(2948): Finished flush of dataSize ~375.65 KB/384665, heapSize ~451.95 KB/462792, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 25ms, sequenceid=899, compaction requested=false 2023-07-24 12:30:19,961 INFO [M:0;jenkins-hbase6:38215] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 12:30:19,961 DEBUG [M:0;jenkins-hbase6:38215] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 12:30:19,965 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 12:30:19,965 INFO [M:0;jenkins-hbase6:38215] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-24 12:30:19,966 INFO [M:0;jenkins-hbase6:38215] ipc.NettyRpcServer(158): Stopping server on /172.31.2.20:38215 2023-07-24 12:30:19,972 DEBUG [M:0;jenkins-hbase6:38215] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase6.apache.org,38215,1690201657817 already deleted, retry=false 2023-07-24 12:30:20,030 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 12:30:20,030 INFO [RS:0;jenkins-hbase6:44517] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase6.apache.org,44517,1690201659253; zookeeper connection closed. 2023-07-24 12:30:20,030 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): regionserver:44517-0x100bed88b280001, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 12:30:20,030 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@353814d2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@353814d2 2023-07-24 12:30:20,031 INFO [Listener at jenkins-hbase6.apache.org/41373] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-24 12:30:20,130 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 12:30:20,130 INFO [M:0;jenkins-hbase6:38215] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase6.apache.org,38215,1690201657817; zookeeper connection closed. 2023-07-24 12:30:20,130 DEBUG [Listener at localhost/36245-EventThread] zookeeper.ZKWatcher(600): master:38215-0x100bed88b280000, quorum=127.0.0.1:49553, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 12:30:20,132 WARN [Listener at jenkins-hbase6.apache.org/41373] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 12:30:20,137 INFO [Listener at jenkins-hbase6.apache.org/41373] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 12:30:20,243 WARN [BP-1803668874-172.31.2.20-1690201653737 heartbeating to localhost/127.0.0.1:42387] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 12:30:20,243 WARN [BP-1803668874-172.31.2.20-1690201653737 heartbeating to localhost/127.0.0.1:42387] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1803668874-172.31.2.20-1690201653737 (Datanode Uuid a24b1a35-a6c9-45ab-9b01-0351356200d8) service to localhost/127.0.0.1:42387 2023-07-24 12:30:20,245 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/cluster_6ecbaa8a-c107-3c9f-ccef-7cf56d65ce13/dfs/data/data5/current/BP-1803668874-172.31.2.20-1690201653737] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 12:30:20,245 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/cluster_6ecbaa8a-c107-3c9f-ccef-7cf56d65ce13/dfs/data/data6/current/BP-1803668874-172.31.2.20-1690201653737] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 12:30:20,248 WARN [Listener at jenkins-hbase6.apache.org/41373] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 12:30:20,261 INFO [Listener at jenkins-hbase6.apache.org/41373] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 12:30:20,370 WARN [BP-1803668874-172.31.2.20-1690201653737 heartbeating to localhost/127.0.0.1:42387] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 12:30:20,370 WARN [BP-1803668874-172.31.2.20-1690201653737 heartbeating to localhost/127.0.0.1:42387] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1803668874-172.31.2.20-1690201653737 (Datanode Uuid 19d82370-3e19-4894-8366-cabf66b42541) service to localhost/127.0.0.1:42387 2023-07-24 12:30:20,371 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/cluster_6ecbaa8a-c107-3c9f-ccef-7cf56d65ce13/dfs/data/data3/current/BP-1803668874-172.31.2.20-1690201653737] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 12:30:20,371 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/cluster_6ecbaa8a-c107-3c9f-ccef-7cf56d65ce13/dfs/data/data4/current/BP-1803668874-172.31.2.20-1690201653737] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 12:30:20,372 WARN [Listener at jenkins-hbase6.apache.org/41373] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 12:30:20,382 INFO [Listener at jenkins-hbase6.apache.org/41373] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 12:30:20,488 WARN [BP-1803668874-172.31.2.20-1690201653737 heartbeating to localhost/127.0.0.1:42387] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 12:30:20,488 WARN [BP-1803668874-172.31.2.20-1690201653737 heartbeating to localhost/127.0.0.1:42387] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1803668874-172.31.2.20-1690201653737 (Datanode Uuid 23f2ea4b-c4a7-41c7-aadd-6ec06db9adb1) service to localhost/127.0.0.1:42387 2023-07-24 12:30:20,489 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/cluster_6ecbaa8a-c107-3c9f-ccef-7cf56d65ce13/dfs/data/data1/current/BP-1803668874-172.31.2.20-1690201653737] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 12:30:20,489 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/58dfaba2-be75-b605-766b-1cec4218f7ce/cluster_6ecbaa8a-c107-3c9f-ccef-7cf56d65ce13/dfs/data/data2/current/BP-1803668874-172.31.2.20-1690201653737] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 12:30:20,534 INFO [Listener at jenkins-hbase6.apache.org/41373] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 12:30:20,569 INFO [Listener at jenkins-hbase6.apache.org/41373] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-24 12:30:20,706 INFO [Listener at jenkins-hbase6.apache.org/41373] hbase.HBaseTestingUtility(1293): Minicluster is down