2023-07-24 16:05:47,227 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-24 16:05:47,485 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324 2023-07-24 16:05:47,485 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-24 16:05:47,486 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-24 16:05:47,533 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-24 16:05:47,837 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-24 16:05:47,838 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/cluster_b8887cf5-a132-099c-754f-127401d6508d, deleteOnExit=true 2023-07-24 16:05:47,838 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-24 16:05:47,839 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/test.cache.data in system properties and HBase conf 2023-07-24 16:05:47,839 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/hadoop.tmp.dir in system properties and HBase conf 2023-07-24 16:05:47,840 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/hadoop.log.dir in system properties and HBase conf 2023-07-24 16:05:47,840 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-24 16:05:47,841 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-24 16:05:47,841 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-24 16:05:48,230 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-24 16:05:48,236 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-24 16:05:48,237 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-24 16:05:48,237 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-24 16:05:48,237 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 16:05:48,237 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-24 16:05:48,238 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-24 16:05:48,238 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 16:05:48,239 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 16:05:48,239 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-24 16:05:48,239 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/nfs.dump.dir in system properties and HBase conf 2023-07-24 16:05:48,240 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/java.io.tmpdir in system properties and HBase conf 2023-07-24 16:05:48,240 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 16:05:48,241 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-24 16:05:48,241 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-24 16:05:48,938 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-24 16:05:48,944 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-24 16:05:49,331 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-24 16:05:49,584 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-24 16:05:49,604 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 16:05:49,660 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 16:05:49,711 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/java.io.tmpdir/Jetty_localhost_34075_hdfs____rsq307/webapp 2023-07-24 16:05:49,898 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34075 2023-07-24 16:05:49,909 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-24 16:05:49,910 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-24 16:05:50,477 WARN [Listener at localhost/32943] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 16:05:50,568 WARN [Listener at localhost/32943] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 16:05:50,598 WARN [Listener at localhost/32943] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 16:05:50,608 INFO [Listener at localhost/32943] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 16:05:50,748 INFO [Listener at localhost/32943] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/java.io.tmpdir/Jetty_localhost_39063_datanode____.7w4x5e/webapp 2023-07-24 16:05:50,896 INFO [Listener at localhost/32943] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39063 2023-07-24 16:05:51,443 WARN [Listener at localhost/35099] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 16:05:51,515 WARN [Listener at localhost/35099] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 16:05:51,520 WARN [Listener at localhost/35099] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 16:05:51,523 INFO [Listener at localhost/35099] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 16:05:51,533 INFO [Listener at localhost/35099] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/java.io.tmpdir/Jetty_localhost_39697_datanode____q6d7yt/webapp 2023-07-24 16:05:51,680 INFO [Listener at localhost/35099] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39697 2023-07-24 16:05:51,726 WARN [Listener at localhost/43183] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 16:05:51,774 WARN [Listener at localhost/43183] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 16:05:51,778 WARN [Listener at localhost/43183] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 16:05:51,780 INFO [Listener at localhost/43183] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 16:05:51,789 INFO [Listener at localhost/43183] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/java.io.tmpdir/Jetty_localhost_46725_datanode____ozna3j/webapp 2023-07-24 16:05:51,935 INFO [Listener at localhost/43183] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46725 2023-07-24 16:05:51,951 WARN [Listener at localhost/34603] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 16:05:52,284 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb06568788d8ae227: Processing first storage report for DS-542270bc-4529-4325-bcca-b4aa61024f13 from datanode 9d959e46-5f9c-42f7-8ae7-8c931c1d82da 2023-07-24 16:05:52,286 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb06568788d8ae227: from storage DS-542270bc-4529-4325-bcca-b4aa61024f13 node DatanodeRegistration(127.0.0.1:46569, datanodeUuid=9d959e46-5f9c-42f7-8ae7-8c931c1d82da, infoPort=45035, infoSecurePort=0, ipcPort=35099, storageInfo=lv=-57;cid=testClusterID;nsid=278733401;c=1690214749043), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-24 16:05:52,286 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x421ffd1b3c24774b: Processing first storage report for DS-7042fed8-6b98-433e-926b-4d4957b38b7b from datanode 271caa12-d49f-4a14-ba62-4ce050b414e0 2023-07-24 16:05:52,286 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x421ffd1b3c24774b: from storage DS-7042fed8-6b98-433e-926b-4d4957b38b7b node DatanodeRegistration(127.0.0.1:41339, datanodeUuid=271caa12-d49f-4a14-ba62-4ce050b414e0, infoPort=34665, infoSecurePort=0, ipcPort=43183, storageInfo=lv=-57;cid=testClusterID;nsid=278733401;c=1690214749043), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-24 16:05:52,287 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x231185867d31989c: Processing first storage report for DS-7159f595-36fe-4bb5-9115-8f0e45047ad7 from datanode 1fdb8e1b-1e91-4251-a6bf-be452c270217 2023-07-24 16:05:52,287 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x231185867d31989c: from storage DS-7159f595-36fe-4bb5-9115-8f0e45047ad7 node DatanodeRegistration(127.0.0.1:38625, datanodeUuid=1fdb8e1b-1e91-4251-a6bf-be452c270217, infoPort=42547, infoSecurePort=0, ipcPort=34603, storageInfo=lv=-57;cid=testClusterID;nsid=278733401;c=1690214749043), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 16:05:52,287 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb06568788d8ae227: Processing first storage report for DS-a95606e6-fffc-4cee-b189-d03df3d42078 from datanode 9d959e46-5f9c-42f7-8ae7-8c931c1d82da 2023-07-24 16:05:52,287 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb06568788d8ae227: from storage DS-a95606e6-fffc-4cee-b189-d03df3d42078 node DatanodeRegistration(127.0.0.1:46569, datanodeUuid=9d959e46-5f9c-42f7-8ae7-8c931c1d82da, infoPort=45035, infoSecurePort=0, ipcPort=35099, storageInfo=lv=-57;cid=testClusterID;nsid=278733401;c=1690214749043), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 16:05:52,287 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x421ffd1b3c24774b: Processing first storage report for DS-8af98090-29b9-4f45-8746-af9506578e1b from datanode 271caa12-d49f-4a14-ba62-4ce050b414e0 2023-07-24 16:05:52,287 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x421ffd1b3c24774b: from storage DS-8af98090-29b9-4f45-8746-af9506578e1b node DatanodeRegistration(127.0.0.1:41339, datanodeUuid=271caa12-d49f-4a14-ba62-4ce050b414e0, infoPort=34665, infoSecurePort=0, ipcPort=43183, storageInfo=lv=-57;cid=testClusterID;nsid=278733401;c=1690214749043), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 16:05:52,287 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x231185867d31989c: Processing first storage report for DS-a6dbc580-2892-4a4e-ba6c-870f2414b129 from datanode 1fdb8e1b-1e91-4251-a6bf-be452c270217 2023-07-24 16:05:52,287 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x231185867d31989c: from storage DS-a6dbc580-2892-4a4e-ba6c-870f2414b129 node DatanodeRegistration(127.0.0.1:38625, datanodeUuid=1fdb8e1b-1e91-4251-a6bf-be452c270217, infoPort=42547, infoSecurePort=0, ipcPort=34603, storageInfo=lv=-57;cid=testClusterID;nsid=278733401;c=1690214749043), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 16:05:52,498 DEBUG [Listener at localhost/34603] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324 2023-07-24 16:05:52,622 INFO [Listener at localhost/34603] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/cluster_b8887cf5-a132-099c-754f-127401d6508d/zookeeper_0, clientPort=49766, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/cluster_b8887cf5-a132-099c-754f-127401d6508d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/cluster_b8887cf5-a132-099c-754f-127401d6508d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-24 16:05:52,648 INFO [Listener at localhost/34603] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=49766 2023-07-24 16:05:52,656 INFO [Listener at localhost/34603] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 16:05:52,660 INFO [Listener at localhost/34603] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 16:05:53,381 INFO [Listener at localhost/34603] util.FSUtils(471): Created version file at hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0 with version=8 2023-07-24 16:05:53,381 INFO [Listener at localhost/34603] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/hbase-staging 2023-07-24 16:05:53,791 INFO [Listener at localhost/34603] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-24 16:05:54,476 INFO [Listener at localhost/34603] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 16:05:54,521 INFO [Listener at localhost/34603] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 16:05:54,522 INFO [Listener at localhost/34603] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 16:05:54,522 INFO [Listener at localhost/34603] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 16:05:54,522 INFO [Listener at localhost/34603] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 16:05:54,522 INFO [Listener at localhost/34603] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 16:05:54,684 INFO [Listener at localhost/34603] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 16:05:54,791 DEBUG [Listener at localhost/34603] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-24 16:05:54,922 INFO [Listener at localhost/34603] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43489 2023-07-24 16:05:54,941 INFO [Listener at localhost/34603] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 16:05:54,944 INFO [Listener at localhost/34603] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 16:05:54,978 INFO [Listener at localhost/34603] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43489 connecting to ZooKeeper ensemble=127.0.0.1:49766 2023-07-24 16:05:55,053 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:434890x0, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 16:05:55,057 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:43489-0x1019814e4520000 connected 2023-07-24 16:05:55,108 DEBUG [Listener at localhost/34603] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 16:05:55,109 DEBUG [Listener at localhost/34603] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 16:05:55,122 DEBUG [Listener at localhost/34603] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 16:05:55,131 DEBUG [Listener at localhost/34603] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43489 2023-07-24 16:05:55,131 DEBUG [Listener at localhost/34603] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43489 2023-07-24 16:05:55,132 DEBUG [Listener at localhost/34603] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43489 2023-07-24 16:05:55,133 DEBUG [Listener at localhost/34603] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43489 2023-07-24 16:05:55,136 DEBUG [Listener at localhost/34603] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43489 2023-07-24 16:05:55,143 INFO [Listener at localhost/34603] master.HMaster(444): hbase.rootdir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0, hbase.cluster.distributed=false 2023-07-24 16:05:55,222 INFO [Listener at localhost/34603] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 16:05:55,223 INFO [Listener at localhost/34603] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 16:05:55,223 INFO [Listener at localhost/34603] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 16:05:55,223 INFO [Listener at localhost/34603] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 16:05:55,223 INFO [Listener at localhost/34603] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 16:05:55,224 INFO [Listener at localhost/34603] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 16:05:55,230 INFO [Listener at localhost/34603] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 16:05:55,234 INFO [Listener at localhost/34603] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33053 2023-07-24 16:05:55,237 INFO [Listener at localhost/34603] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 16:05:55,249 INFO [Listener at localhost/34603] mob.MobFileCache(124): MobFileCache disabled 2023-07-24 16:05:55,250 INFO [Listener at localhost/34603] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 16:05:55,252 INFO [Listener at localhost/34603] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 16:05:55,254 INFO [Listener at localhost/34603] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33053 connecting to ZooKeeper ensemble=127.0.0.1:49766 2023-07-24 16:05:55,258 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:330530x0, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 16:05:55,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33053-0x1019814e4520001 connected 2023-07-24 16:05:55,259 DEBUG [Listener at localhost/34603] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 16:05:55,260 DEBUG [Listener at localhost/34603] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 16:05:55,261 DEBUG [Listener at localhost/34603] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 16:05:55,262 DEBUG [Listener at localhost/34603] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33053 2023-07-24 16:05:55,262 DEBUG [Listener at localhost/34603] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33053 2023-07-24 16:05:55,264 DEBUG [Listener at localhost/34603] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33053 2023-07-24 16:05:55,265 DEBUG [Listener at localhost/34603] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33053 2023-07-24 16:05:55,265 DEBUG [Listener at localhost/34603] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33053 2023-07-24 16:05:55,283 INFO [Listener at localhost/34603] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 16:05:55,283 INFO [Listener at localhost/34603] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 16:05:55,283 INFO [Listener at localhost/34603] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 16:05:55,284 INFO [Listener at localhost/34603] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 16:05:55,284 INFO [Listener at localhost/34603] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 16:05:55,284 INFO [Listener at localhost/34603] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 16:05:55,284 INFO [Listener at localhost/34603] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 16:05:55,286 INFO [Listener at localhost/34603] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38047 2023-07-24 16:05:55,286 INFO [Listener at localhost/34603] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 16:05:55,287 INFO [Listener at localhost/34603] mob.MobFileCache(124): MobFileCache disabled 2023-07-24 16:05:55,288 INFO [Listener at localhost/34603] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 16:05:55,291 INFO [Listener at localhost/34603] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 16:05:55,293 INFO [Listener at localhost/34603] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38047 connecting to ZooKeeper ensemble=127.0.0.1:49766 2023-07-24 16:05:55,300 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:380470x0, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 16:05:55,301 DEBUG [Listener at localhost/34603] zookeeper.ZKUtil(164): regionserver:380470x0, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 16:05:55,302 DEBUG [Listener at localhost/34603] zookeeper.ZKUtil(164): regionserver:380470x0, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 16:05:55,303 DEBUG [Listener at localhost/34603] zookeeper.ZKUtil(164): regionserver:380470x0, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 16:05:55,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38047-0x1019814e4520002 connected 2023-07-24 16:05:55,310 DEBUG [Listener at localhost/34603] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38047 2023-07-24 16:05:55,310 DEBUG [Listener at localhost/34603] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38047 2023-07-24 16:05:55,310 DEBUG [Listener at localhost/34603] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38047 2023-07-24 16:05:55,314 DEBUG [Listener at localhost/34603] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38047 2023-07-24 16:05:55,315 DEBUG [Listener at localhost/34603] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38047 2023-07-24 16:05:55,330 INFO [Listener at localhost/34603] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 16:05:55,330 INFO [Listener at localhost/34603] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 16:05:55,330 INFO [Listener at localhost/34603] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 16:05:55,330 INFO [Listener at localhost/34603] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 16:05:55,330 INFO [Listener at localhost/34603] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 16:05:55,331 INFO [Listener at localhost/34603] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 16:05:55,331 INFO [Listener at localhost/34603] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 16:05:55,334 INFO [Listener at localhost/34603] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33229 2023-07-24 16:05:55,334 INFO [Listener at localhost/34603] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 16:05:55,338 INFO [Listener at localhost/34603] mob.MobFileCache(124): MobFileCache disabled 2023-07-24 16:05:55,339 INFO [Listener at localhost/34603] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 16:05:55,342 INFO [Listener at localhost/34603] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 16:05:55,343 INFO [Listener at localhost/34603] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33229 connecting to ZooKeeper ensemble=127.0.0.1:49766 2023-07-24 16:05:55,355 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:332290x0, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 16:05:55,356 DEBUG [Listener at localhost/34603] zookeeper.ZKUtil(164): regionserver:332290x0, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 16:05:55,356 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33229-0x1019814e4520003 connected 2023-07-24 16:05:55,358 DEBUG [Listener at localhost/34603] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 16:05:55,359 DEBUG [Listener at localhost/34603] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 16:05:55,363 DEBUG [Listener at localhost/34603] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33229 2023-07-24 16:05:55,366 DEBUG [Listener at localhost/34603] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33229 2023-07-24 16:05:55,370 DEBUG [Listener at localhost/34603] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33229 2023-07-24 16:05:55,371 DEBUG [Listener at localhost/34603] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33229 2023-07-24 16:05:55,373 DEBUG [Listener at localhost/34603] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33229 2023-07-24 16:05:55,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,43489,1690214753588 2023-07-24 16:05:55,403 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-24 16:05:55,406 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,43489,1690214753588 2023-07-24 16:05:55,431 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 16:05:55,432 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 16:05:55,432 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 16:05:55,432 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 16:05:55,432 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 16:05:55,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-24 16:05:55,437 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-24 16:05:55,438 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,43489,1690214753588 from backup master directory 2023-07-24 16:05:55,443 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,43489,1690214753588 2023-07-24 16:05:55,443 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-24 16:05:55,444 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 16:05:55,444 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,43489,1690214753588 2023-07-24 16:05:55,448 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-24 16:05:55,451 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-24 16:05:55,577 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/hbase.id with ID: 1e2b874b-bd97-4679-8732-52de5c09bb56 2023-07-24 16:05:55,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 16:05:55,647 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 16:05:55,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6ee720ca to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:05:55,783 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@224dae4c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:05:55,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 16:05:55,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-24 16:05:55,834 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-24 16:05:55,834 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-24 16:05:55,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-24 16:05:55,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-24 16:05:55,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 16:05:55,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/MasterData/data/master/store-tmp 2023-07-24 16:05:55,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:05:55,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-24 16:05:55,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 16:05:55,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 16:05:55,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-24 16:05:55,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 16:05:55,976 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 16:05:55,976 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 16:05:55,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/MasterData/WALs/jenkins-hbase4.apache.org,43489,1690214753588 2023-07-24 16:05:56,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43489%2C1690214753588, suffix=, logDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/MasterData/WALs/jenkins-hbase4.apache.org,43489,1690214753588, archiveDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/MasterData/oldWALs, maxLogs=10 2023-07-24 16:05:56,092 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38625,DS-7159f595-36fe-4bb5-9115-8f0e45047ad7,DISK] 2023-07-24 16:05:56,092 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41339,DS-7042fed8-6b98-433e-926b-4d4957b38b7b,DISK] 2023-07-24 16:05:56,092 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46569,DS-542270bc-4529-4325-bcca-b4aa61024f13,DISK] 2023-07-24 16:05:56,103 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-24 16:05:56,184 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/MasterData/WALs/jenkins-hbase4.apache.org,43489,1690214753588/jenkins-hbase4.apache.org%2C43489%2C1690214753588.1690214756023 2023-07-24 16:05:56,184 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41339,DS-7042fed8-6b98-433e-926b-4d4957b38b7b,DISK], DatanodeInfoWithStorage[127.0.0.1:46569,DS-542270bc-4529-4325-bcca-b4aa61024f13,DISK], DatanodeInfoWithStorage[127.0.0.1:38625,DS-7159f595-36fe-4bb5-9115-8f0e45047ad7,DISK]] 2023-07-24 16:05:56,185 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-24 16:05:56,185 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:05:56,188 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 16:05:56,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 16:05:56,252 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-24 16:05:56,261 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-24 16:05:56,302 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-24 16:05:56,320 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 16:05:56,327 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-24 16:05:56,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-24 16:05:56,352 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 16:05:56,356 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 16:05:56,357 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60354887, jitterRate=-0.10064209997653961}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 16:05:56,357 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 16:05:56,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-24 16:05:56,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-24 16:05:56,384 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-24 16:05:56,388 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-24 16:05:56,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-24 16:05:56,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 37 msec 2023-07-24 16:05:56,428 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-24 16:05:56,480 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-24 16:05:56,488 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-24 16:05:56,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-24 16:05:56,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-24 16:05:56,532 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-24 16:05:56,538 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-24 16:05:56,544 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-24 16:05:56,547 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 16:05:56,551 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-24 16:05:56,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-24 16:05:56,579 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-24 16:05:56,585 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 16:05:56,585 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 16:05:56,585 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 16:05:56,586 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 16:05:56,585 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 16:05:56,587 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,43489,1690214753588, sessionid=0x1019814e4520000, setting cluster-up flag (Was=false) 2023-07-24 16:05:56,606 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 16:05:56,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-24 16:05:56,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43489,1690214753588 2023-07-24 16:05:56,622 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 16:05:56,627 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-24 16:05:56,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43489,1690214753588 2023-07-24 16:05:56,633 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp 2023-07-24 16:05:56,691 INFO [RS:0;jenkins-hbase4:33053] regionserver.HRegionServer(951): ClusterId : 1e2b874b-bd97-4679-8732-52de5c09bb56 2023-07-24 16:05:56,697 INFO [RS:1;jenkins-hbase4:38047] regionserver.HRegionServer(951): ClusterId : 1e2b874b-bd97-4679-8732-52de5c09bb56 2023-07-24 16:05:56,705 DEBUG [RS:0;jenkins-hbase4:33053] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 16:05:56,705 DEBUG [RS:1;jenkins-hbase4:38047] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 16:05:56,707 INFO [RS:2;jenkins-hbase4:33229] regionserver.HRegionServer(951): ClusterId : 1e2b874b-bd97-4679-8732-52de5c09bb56 2023-07-24 16:05:56,708 DEBUG [RS:2;jenkins-hbase4:33229] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 16:05:56,714 DEBUG [RS:0;jenkins-hbase4:33053] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 16:05:56,714 DEBUG [RS:2;jenkins-hbase4:33229] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 16:05:56,714 DEBUG [RS:0;jenkins-hbase4:33053] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 16:05:56,714 DEBUG [RS:2;jenkins-hbase4:33229] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 16:05:56,720 DEBUG [RS:1;jenkins-hbase4:38047] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 16:05:56,720 DEBUG [RS:1;jenkins-hbase4:38047] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 16:05:56,721 DEBUG [RS:2;jenkins-hbase4:33229] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 16:05:56,723 DEBUG [RS:2;jenkins-hbase4:33229] zookeeper.ReadOnlyZKClient(139): Connect 0x1bbbc2ce to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:05:56,723 DEBUG [RS:0;jenkins-hbase4:33053] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 16:05:56,725 DEBUG [RS:1;jenkins-hbase4:38047] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 16:05:56,729 DEBUG [RS:0;jenkins-hbase4:33053] zookeeper.ReadOnlyZKClient(139): Connect 0x297f6a86 to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:05:56,731 DEBUG [RS:1;jenkins-hbase4:38047] zookeeper.ReadOnlyZKClient(139): Connect 0x76862469 to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:05:56,792 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-24 16:05:56,795 DEBUG [RS:2;jenkins-hbase4:33229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@157c3fc9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:05:56,798 DEBUG [RS:2;jenkins-hbase4:33229] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1143a9be, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 16:05:56,800 DEBUG [RS:0;jenkins-hbase4:33053] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@27b891d9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:05:56,800 DEBUG [RS:0;jenkins-hbase4:33053] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@238701f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 16:05:56,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 16:05:56,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-24 16:05:56,851 DEBUG [RS:1;jenkins-hbase4:38047] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7841d4c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:05:56,852 DEBUG [RS:1;jenkins-hbase4:38047] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@397cdef2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 16:05:56,870 DEBUG [RS:1;jenkins-hbase4:38047] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38047 2023-07-24 16:05:56,874 DEBUG [RS:2;jenkins-hbase4:33229] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:33229 2023-07-24 16:05:56,871 DEBUG [RS:0;jenkins-hbase4:33053] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:33053 2023-07-24 16:05:56,879 INFO [RS:1;jenkins-hbase4:38047] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 16:05:56,879 INFO [RS:1;jenkins-hbase4:38047] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 16:05:56,879 DEBUG [RS:1;jenkins-hbase4:38047] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 16:05:56,880 INFO [RS:1;jenkins-hbase4:38047] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 16:05:56,880 INFO [RS:2;jenkins-hbase4:33229] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 16:05:56,881 DEBUG [RS:1;jenkins-hbase4:38047] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 16:05:56,880 INFO [RS:0;jenkins-hbase4:33053] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 16:05:56,881 INFO [RS:2;jenkins-hbase4:33229] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 16:05:56,881 INFO [RS:0;jenkins-hbase4:33053] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 16:05:56,881 DEBUG [RS:2;jenkins-hbase4:33229] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 16:05:56,881 DEBUG [RS:0;jenkins-hbase4:33053] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 16:05:56,882 INFO [RS:2;jenkins-hbase4:33229] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 16:05:56,882 INFO [RS:0;jenkins-hbase4:33053] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 16:05:56,882 DEBUG [RS:0;jenkins-hbase4:33053] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 16:05:56,882 DEBUG [RS:2;jenkins-hbase4:33229] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 16:05:56,885 INFO [RS:1;jenkins-hbase4:38047] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43489,1690214753588 with isa=jenkins-hbase4.apache.org/172.31.14.131:38047, startcode=1690214755282 2023-07-24 16:05:56,885 INFO [RS:2;jenkins-hbase4:33229] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43489,1690214753588 with isa=jenkins-hbase4.apache.org/172.31.14.131:33229, startcode=1690214755329 2023-07-24 16:05:56,885 INFO [RS:0;jenkins-hbase4:33053] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43489,1690214753588 with isa=jenkins-hbase4.apache.org/172.31.14.131:33053, startcode=1690214755222 2023-07-24 16:05:56,908 DEBUG [RS:2;jenkins-hbase4:33229] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 16:05:56,908 DEBUG [RS:0;jenkins-hbase4:33053] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 16:05:56,908 DEBUG [RS:1;jenkins-hbase4:38047] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 16:05:56,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-24 16:05:56,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 16:05:56,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 16:05:56,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 16:05:56,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 16:05:56,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-24 16:05:56,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:56,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 16:05:56,982 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:56,984 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52193, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 16:05:56,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690214786995 2023-07-24 16:05:56,986 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47549, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 16:05:56,987 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46849, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 16:05:56,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-24 16:05:57,001 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43489] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 16:05:57,014 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-24 16:05:57,018 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43489] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 16:05:57,019 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43489] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 16:05:57,021 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-24 16:05:57,022 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-24 16:05:57,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-24 16:05:57,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-24 16:05:57,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-24 16:05:57,030 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-24 16:05:57,031 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:57,031 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 16:05:57,032 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-24 16:05:57,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-24 16:05:57,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-24 16:05:57,051 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-24 16:05:57,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-24 16:05:57,057 DEBUG [RS:2;jenkins-hbase4:33229] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 16:05:57,058 DEBUG [RS:0;jenkins-hbase4:33053] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 16:05:57,058 DEBUG [RS:1;jenkins-hbase4:38047] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 16:05:57,058 WARN [RS:1;jenkins-hbase4:38047] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 16:05:57,057 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690214757054,5,FailOnTimeoutGroup] 2023-07-24 16:05:57,058 WARN [RS:0;jenkins-hbase4:33053] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 16:05:57,058 WARN [RS:2;jenkins-hbase4:33229] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 16:05:57,066 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690214757062,5,FailOnTimeoutGroup] 2023-07-24 16:05:57,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:57,079 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-24 16:05:57,081 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:57,081 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:57,122 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-24 16:05:57,123 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-24 16:05:57,124 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0 2023-07-24 16:05:57,160 INFO [RS:1;jenkins-hbase4:38047] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43489,1690214753588 with isa=jenkins-hbase4.apache.org/172.31.14.131:38047, startcode=1690214755282 2023-07-24 16:05:57,163 INFO [RS:0;jenkins-hbase4:33053] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43489,1690214753588 with isa=jenkins-hbase4.apache.org/172.31.14.131:33053, startcode=1690214755222 2023-07-24 16:05:57,164 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:05:57,163 INFO [RS:2;jenkins-hbase4:33229] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,43489,1690214753588 with isa=jenkins-hbase4.apache.org/172.31.14.131:33229, startcode=1690214755329 2023-07-24 16:05:57,168 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43489] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:05:57,173 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43489] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:05:57,175 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43489] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:05:57,177 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-24 16:05:57,178 DEBUG [RS:2;jenkins-hbase4:33229] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0 2023-07-24 16:05:57,178 DEBUG [RS:1;jenkins-hbase4:38047] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0 2023-07-24 16:05:57,178 DEBUG [RS:0;jenkins-hbase4:33053] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0 2023-07-24 16:05:57,178 DEBUG [RS:1;jenkins-hbase4:38047] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:32943 2023-07-24 16:05:57,178 DEBUG [RS:2;jenkins-hbase4:33229] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:32943 2023-07-24 16:05:57,179 DEBUG [RS:2;jenkins-hbase4:33229] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 16:05:57,178 DEBUG [RS:1;jenkins-hbase4:38047] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 16:05:57,178 DEBUG [RS:0;jenkins-hbase4:33053] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:32943 2023-07-24 16:05:57,183 DEBUG [RS:0;jenkins-hbase4:33053] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 16:05:57,185 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740/info 2023-07-24 16:05:57,186 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-24 16:05:57,187 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 16:05:57,187 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 16:05:57,189 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-24 16:05:57,200 DEBUG [RS:0;jenkins-hbase4:33053] zookeeper.ZKUtil(162): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:05:57,200 WARN [RS:0;jenkins-hbase4:33053] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 16:05:57,201 INFO [RS:0;jenkins-hbase4:33053] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 16:05:57,201 DEBUG [RS:0;jenkins-hbase4:33053] regionserver.HRegionServer(1948): logDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/WALs/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:05:57,203 DEBUG [RS:2;jenkins-hbase4:33229] zookeeper.ZKUtil(162): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:05:57,205 DEBUG [RS:1;jenkins-hbase4:38047] zookeeper.ZKUtil(162): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:05:57,208 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33229,1690214755329] 2023-07-24 16:05:57,208 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38047,1690214755282] 2023-07-24 16:05:57,208 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740/rep_barrier 2023-07-24 16:05:57,208 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33053,1690214755222] 2023-07-24 16:05:57,209 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-24 16:05:57,211 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 16:05:57,211 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-24 16:05:57,214 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740/table 2023-07-24 16:05:57,215 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-24 16:05:57,203 WARN [RS:2;jenkins-hbase4:33229] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 16:05:57,205 WARN [RS:1;jenkins-hbase4:38047] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 16:05:57,225 INFO [RS:1;jenkins-hbase4:38047] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 16:05:57,224 INFO [RS:2;jenkins-hbase4:33229] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 16:05:57,225 DEBUG [RS:1;jenkins-hbase4:38047] regionserver.HRegionServer(1948): logDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/WALs/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:05:57,225 DEBUG [RS:2;jenkins-hbase4:33229] regionserver.HRegionServer(1948): logDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/WALs/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:05:57,225 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 16:05:57,264 DEBUG [RS:0;jenkins-hbase4:33053] zookeeper.ZKUtil(162): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:05:57,264 DEBUG [RS:1;jenkins-hbase4:38047] zookeeper.ZKUtil(162): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:05:57,264 DEBUG [RS:0;jenkins-hbase4:33053] zookeeper.ZKUtil(162): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:05:57,264 DEBUG [RS:1;jenkins-hbase4:38047] zookeeper.ZKUtil(162): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:05:57,265 DEBUG [RS:0;jenkins-hbase4:33053] zookeeper.ZKUtil(162): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:05:57,265 DEBUG [RS:1;jenkins-hbase4:38047] zookeeper.ZKUtil(162): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:05:57,267 DEBUG [RS:2;jenkins-hbase4:33229] zookeeper.ZKUtil(162): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:05:57,268 DEBUG [RS:2;jenkins-hbase4:33229] zookeeper.ZKUtil(162): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:05:57,271 DEBUG [RS:2;jenkins-hbase4:33229] zookeeper.ZKUtil(162): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:05:57,274 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740 2023-07-24 16:05:57,275 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740 2023-07-24 16:05:57,280 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-24 16:05:57,282 DEBUG [RS:0;jenkins-hbase4:33053] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 16:05:57,282 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-24 16:05:57,283 DEBUG [RS:2;jenkins-hbase4:33229] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 16:05:57,283 DEBUG [RS:1;jenkins-hbase4:38047] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 16:05:57,288 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 16:05:57,289 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71610784, jitterRate=0.06708383560180664}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-24 16:05:57,289 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-24 16:05:57,289 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-24 16:05:57,289 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-24 16:05:57,290 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-24 16:05:57,290 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-24 16:05:57,290 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-24 16:05:57,291 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-24 16:05:57,291 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-24 16:05:57,296 INFO [RS:2;jenkins-hbase4:33229] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 16:05:57,296 INFO [RS:1;jenkins-hbase4:38047] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 16:05:57,297 INFO [RS:0;jenkins-hbase4:33053] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 16:05:57,298 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-24 16:05:57,299 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-24 16:05:57,311 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-24 16:05:57,325 INFO [RS:1;jenkins-hbase4:38047] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 16:05:57,328 INFO [RS:2;jenkins-hbase4:33229] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 16:05:57,333 INFO [RS:0;jenkins-hbase4:33053] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 16:05:57,336 INFO [RS:0;jenkins-hbase4:33053] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 16:05:57,336 INFO [RS:1;jenkins-hbase4:38047] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 16:05:57,336 INFO [RS:0;jenkins-hbase4:33053] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:57,336 INFO [RS:2;jenkins-hbase4:33229] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 16:05:57,345 INFO [RS:2;jenkins-hbase4:33229] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:57,337 INFO [RS:1;jenkins-hbase4:38047] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:57,350 INFO [RS:2;jenkins-hbase4:33229] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 16:05:57,350 INFO [RS:0;jenkins-hbase4:33053] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 16:05:57,352 INFO [RS:1;jenkins-hbase4:38047] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 16:05:57,352 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-24 16:05:57,360 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-24 16:05:57,363 INFO [RS:2;jenkins-hbase4:33229] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:57,363 DEBUG [RS:2;jenkins-hbase4:33229] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,364 DEBUG [RS:2;jenkins-hbase4:33229] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,364 DEBUG [RS:2;jenkins-hbase4:33229] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,364 DEBUG [RS:2;jenkins-hbase4:33229] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,364 DEBUG [RS:2;jenkins-hbase4:33229] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,364 DEBUG [RS:2;jenkins-hbase4:33229] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 16:05:57,364 DEBUG [RS:2;jenkins-hbase4:33229] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,364 DEBUG [RS:2;jenkins-hbase4:33229] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,364 DEBUG [RS:2;jenkins-hbase4:33229] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,364 DEBUG [RS:2;jenkins-hbase4:33229] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,365 INFO [RS:0;jenkins-hbase4:33053] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:57,365 INFO [RS:1;jenkins-hbase4:38047] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:57,366 DEBUG [RS:0;jenkins-hbase4:33053] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,377 DEBUG [RS:1;jenkins-hbase4:38047] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,377 DEBUG [RS:1;jenkins-hbase4:38047] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,377 DEBUG [RS:0;jenkins-hbase4:33053] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,378 DEBUG [RS:1;jenkins-hbase4:38047] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,378 DEBUG [RS:0;jenkins-hbase4:33053] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,378 DEBUG [RS:1;jenkins-hbase4:38047] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,378 DEBUG [RS:0;jenkins-hbase4:33053] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,378 DEBUG [RS:1;jenkins-hbase4:38047] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,378 DEBUG [RS:0;jenkins-hbase4:33053] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,378 DEBUG [RS:1;jenkins-hbase4:38047] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 16:05:57,378 DEBUG [RS:0;jenkins-hbase4:33053] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 16:05:57,378 DEBUG [RS:1;jenkins-hbase4:38047] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,379 DEBUG [RS:1;jenkins-hbase4:38047] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,379 DEBUG [RS:0;jenkins-hbase4:33053] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,379 DEBUG [RS:1;jenkins-hbase4:38047] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,379 DEBUG [RS:0;jenkins-hbase4:33053] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,379 DEBUG [RS:1;jenkins-hbase4:38047] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,379 DEBUG [RS:0;jenkins-hbase4:33053] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,379 DEBUG [RS:0;jenkins-hbase4:33053] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 16:05:57,390 INFO [RS:2;jenkins-hbase4:33229] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:57,390 INFO [RS:2;jenkins-hbase4:33229] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:57,390 INFO [RS:2;jenkins-hbase4:33229] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:57,421 INFO [RS:2;jenkins-hbase4:33229] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 16:05:57,425 INFO [RS:2;jenkins-hbase4:33229] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33229,1690214755329-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:57,431 INFO [RS:0;jenkins-hbase4:33053] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:57,431 INFO [RS:0;jenkins-hbase4:33053] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:57,431 INFO [RS:0;jenkins-hbase4:33053] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:57,447 INFO [RS:1;jenkins-hbase4:38047] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:57,447 INFO [RS:1;jenkins-hbase4:38047] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:57,447 INFO [RS:1;jenkins-hbase4:38047] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:57,469 INFO [RS:0;jenkins-hbase4:33053] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 16:05:57,471 INFO [RS:0;jenkins-hbase4:33053] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33053,1690214755222-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:57,488 INFO [RS:1;jenkins-hbase4:38047] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 16:05:57,488 INFO [RS:1;jenkins-hbase4:38047] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38047,1690214755282-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:57,489 INFO [RS:2;jenkins-hbase4:33229] regionserver.Replication(203): jenkins-hbase4.apache.org,33229,1690214755329 started 2023-07-24 16:05:57,489 INFO [RS:2;jenkins-hbase4:33229] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33229,1690214755329, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33229, sessionid=0x1019814e4520003 2023-07-24 16:05:57,490 INFO [RS:0;jenkins-hbase4:33053] regionserver.Replication(203): jenkins-hbase4.apache.org,33053,1690214755222 started 2023-07-24 16:05:57,491 INFO [RS:0;jenkins-hbase4:33053] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33053,1690214755222, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33053, sessionid=0x1019814e4520001 2023-07-24 16:05:57,493 DEBUG [RS:2;jenkins-hbase4:33229] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 16:05:57,494 DEBUG [RS:0;jenkins-hbase4:33053] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 16:05:57,495 DEBUG [RS:2;jenkins-hbase4:33229] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:05:57,495 DEBUG [RS:0;jenkins-hbase4:33053] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:05:57,495 DEBUG [RS:2;jenkins-hbase4:33229] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33229,1690214755329' 2023-07-24 16:05:57,495 DEBUG [RS:0;jenkins-hbase4:33053] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33053,1690214755222' 2023-07-24 16:05:57,496 DEBUG [RS:0;jenkins-hbase4:33053] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 16:05:57,496 DEBUG [RS:2;jenkins-hbase4:33229] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 16:05:57,497 DEBUG [RS:2;jenkins-hbase4:33229] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 16:05:57,497 DEBUG [RS:0;jenkins-hbase4:33053] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 16:05:57,497 DEBUG [RS:2;jenkins-hbase4:33229] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 16:05:57,498 DEBUG [RS:2;jenkins-hbase4:33229] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 16:05:57,498 DEBUG [RS:0;jenkins-hbase4:33053] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 16:05:57,498 DEBUG [RS:2;jenkins-hbase4:33229] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:05:57,498 DEBUG [RS:2;jenkins-hbase4:33229] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33229,1690214755329' 2023-07-24 16:05:57,498 DEBUG [RS:2;jenkins-hbase4:33229] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:05:57,498 DEBUG [RS:0;jenkins-hbase4:33053] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 16:05:57,498 DEBUG [RS:0;jenkins-hbase4:33053] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:05:57,499 DEBUG [RS:0;jenkins-hbase4:33053] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33053,1690214755222' 2023-07-24 16:05:57,499 DEBUG [RS:0;jenkins-hbase4:33053] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:05:57,500 DEBUG [RS:2;jenkins-hbase4:33229] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:05:57,500 DEBUG [RS:0;jenkins-hbase4:33053] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:05:57,501 DEBUG [RS:2;jenkins-hbase4:33229] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 16:05:57,501 INFO [RS:2;jenkins-hbase4:33229] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 16:05:57,501 DEBUG [RS:0;jenkins-hbase4:33053] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 16:05:57,501 INFO [RS:2;jenkins-hbase4:33229] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 16:05:57,501 INFO [RS:0;jenkins-hbase4:33053] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 16:05:57,502 INFO [RS:0;jenkins-hbase4:33053] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 16:05:57,509 INFO [RS:1;jenkins-hbase4:38047] regionserver.Replication(203): jenkins-hbase4.apache.org,38047,1690214755282 started 2023-07-24 16:05:57,509 INFO [RS:1;jenkins-hbase4:38047] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,38047,1690214755282, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38047, sessionid=0x1019814e4520002 2023-07-24 16:05:57,509 DEBUG [RS:1;jenkins-hbase4:38047] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 16:05:57,509 DEBUG [RS:1;jenkins-hbase4:38047] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:05:57,509 DEBUG [RS:1;jenkins-hbase4:38047] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38047,1690214755282' 2023-07-24 16:05:57,509 DEBUG [RS:1;jenkins-hbase4:38047] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 16:05:57,509 DEBUG [RS:1;jenkins-hbase4:38047] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 16:05:57,510 DEBUG [RS:1;jenkins-hbase4:38047] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 16:05:57,510 DEBUG [RS:1;jenkins-hbase4:38047] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 16:05:57,510 DEBUG [RS:1;jenkins-hbase4:38047] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:05:57,510 DEBUG [RS:1;jenkins-hbase4:38047] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38047,1690214755282' 2023-07-24 16:05:57,510 DEBUG [RS:1;jenkins-hbase4:38047] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:05:57,511 DEBUG [RS:1;jenkins-hbase4:38047] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:05:57,511 DEBUG [RS:1;jenkins-hbase4:38047] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 16:05:57,511 INFO [RS:1;jenkins-hbase4:38047] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 16:05:57,511 INFO [RS:1;jenkins-hbase4:38047] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 16:05:57,513 DEBUG [jenkins-hbase4:43489] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-24 16:05:57,519 DEBUG [jenkins-hbase4:43489] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 16:05:57,526 DEBUG [jenkins-hbase4:43489] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 16:05:57,526 DEBUG [jenkins-hbase4:43489] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 16:05:57,526 DEBUG [jenkins-hbase4:43489] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 16:05:57,526 DEBUG [jenkins-hbase4:43489] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 16:05:57,530 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33229,1690214755329, state=OPENING 2023-07-24 16:05:57,538 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-24 16:05:57,540 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 16:05:57,541 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-24 16:05:57,546 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33229,1690214755329}] 2023-07-24 16:05:57,613 INFO [RS:2;jenkins-hbase4:33229] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33229%2C1690214755329, suffix=, logDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/WALs/jenkins-hbase4.apache.org,33229,1690214755329, archiveDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/oldWALs, maxLogs=32 2023-07-24 16:05:57,613 INFO [RS:0;jenkins-hbase4:33053] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33053%2C1690214755222, suffix=, logDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/WALs/jenkins-hbase4.apache.org,33053,1690214755222, archiveDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/oldWALs, maxLogs=32 2023-07-24 16:05:57,615 INFO [RS:1;jenkins-hbase4:38047] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38047%2C1690214755282, suffix=, logDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/WALs/jenkins-hbase4.apache.org,38047,1690214755282, archiveDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/oldWALs, maxLogs=32 2023-07-24 16:05:57,643 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41339,DS-7042fed8-6b98-433e-926b-4d4957b38b7b,DISK] 2023-07-24 16:05:57,644 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38625,DS-7159f595-36fe-4bb5-9115-8f0e45047ad7,DISK] 2023-07-24 16:05:57,645 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46569,DS-542270bc-4529-4325-bcca-b4aa61024f13,DISK] 2023-07-24 16:05:57,654 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38625,DS-7159f595-36fe-4bb5-9115-8f0e45047ad7,DISK] 2023-07-24 16:05:57,654 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41339,DS-7042fed8-6b98-433e-926b-4d4957b38b7b,DISK] 2023-07-24 16:05:57,656 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46569,DS-542270bc-4529-4325-bcca-b4aa61024f13,DISK] 2023-07-24 16:05:57,665 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41339,DS-7042fed8-6b98-433e-926b-4d4957b38b7b,DISK] 2023-07-24 16:05:57,665 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38625,DS-7159f595-36fe-4bb5-9115-8f0e45047ad7,DISK] 2023-07-24 16:05:57,667 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46569,DS-542270bc-4529-4325-bcca-b4aa61024f13,DISK] 2023-07-24 16:05:57,668 INFO [RS:0;jenkins-hbase4:33053] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/WALs/jenkins-hbase4.apache.org,33053,1690214755222/jenkins-hbase4.apache.org%2C33053%2C1690214755222.1690214757620 2023-07-24 16:05:57,673 DEBUG [RS:0;jenkins-hbase4:33053] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46569,DS-542270bc-4529-4325-bcca-b4aa61024f13,DISK], DatanodeInfoWithStorage[127.0.0.1:41339,DS-7042fed8-6b98-433e-926b-4d4957b38b7b,DISK], DatanodeInfoWithStorage[127.0.0.1:38625,DS-7159f595-36fe-4bb5-9115-8f0e45047ad7,DISK]] 2023-07-24 16:05:57,676 INFO [RS:2;jenkins-hbase4:33229] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/WALs/jenkins-hbase4.apache.org,33229,1690214755329/jenkins-hbase4.apache.org%2C33229%2C1690214755329.1690214757620 2023-07-24 16:05:57,676 DEBUG [RS:2;jenkins-hbase4:33229] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41339,DS-7042fed8-6b98-433e-926b-4d4957b38b7b,DISK], DatanodeInfoWithStorage[127.0.0.1:38625,DS-7159f595-36fe-4bb5-9115-8f0e45047ad7,DISK], DatanodeInfoWithStorage[127.0.0.1:46569,DS-542270bc-4529-4325-bcca-b4aa61024f13,DISK]] 2023-07-24 16:05:57,677 INFO [RS:1;jenkins-hbase4:38047] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/WALs/jenkins-hbase4.apache.org,38047,1690214755282/jenkins-hbase4.apache.org%2C38047%2C1690214755282.1690214757620 2023-07-24 16:05:57,677 DEBUG [RS:1;jenkins-hbase4:38047] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38625,DS-7159f595-36fe-4bb5-9115-8f0e45047ad7,DISK], DatanodeInfoWithStorage[127.0.0.1:41339,DS-7042fed8-6b98-433e-926b-4d4957b38b7b,DISK], DatanodeInfoWithStorage[127.0.0.1:46569,DS-542270bc-4529-4325-bcca-b4aa61024f13,DISK]] 2023-07-24 16:05:57,749 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:05:57,753 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 16:05:57,756 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34482, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 16:05:57,777 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-24 16:05:57,777 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 16:05:57,781 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33229%2C1690214755329.meta, suffix=.meta, logDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/WALs/jenkins-hbase4.apache.org,33229,1690214755329, archiveDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/oldWALs, maxLogs=32 2023-07-24 16:05:57,805 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41339,DS-7042fed8-6b98-433e-926b-4d4957b38b7b,DISK] 2023-07-24 16:05:57,805 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38625,DS-7159f595-36fe-4bb5-9115-8f0e45047ad7,DISK] 2023-07-24 16:05:57,806 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46569,DS-542270bc-4529-4325-bcca-b4aa61024f13,DISK] 2023-07-24 16:05:57,818 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/WALs/jenkins-hbase4.apache.org,33229,1690214755329/jenkins-hbase4.apache.org%2C33229%2C1690214755329.meta.1690214757783.meta 2023-07-24 16:05:57,819 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46569,DS-542270bc-4529-4325-bcca-b4aa61024f13,DISK], DatanodeInfoWithStorage[127.0.0.1:41339,DS-7042fed8-6b98-433e-926b-4d4957b38b7b,DISK], DatanodeInfoWithStorage[127.0.0.1:38625,DS-7159f595-36fe-4bb5-9115-8f0e45047ad7,DISK]] 2023-07-24 16:05:57,820 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-24 16:05:57,823 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-24 16:05:57,824 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 16:05:57,825 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-24 16:05:57,828 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-24 16:05:57,829 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-24 16:05:57,844 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-24 16:05:57,844 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:05:57,845 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-24 16:05:57,845 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-24 16:05:57,849 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-24 16:05:57,851 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740/info 2023-07-24 16:05:57,851 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740/info 2023-07-24 16:05:57,851 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-24 16:05:57,852 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 16:05:57,852 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-24 16:05:57,854 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740/rep_barrier 2023-07-24 16:05:57,854 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740/rep_barrier 2023-07-24 16:05:57,855 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-24 16:05:57,856 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 16:05:57,856 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-24 16:05:57,858 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740/table 2023-07-24 16:05:57,858 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740/table 2023-07-24 16:05:57,859 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-24 16:05:57,859 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 16:05:57,862 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740 2023-07-24 16:05:57,865 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740 2023-07-24 16:05:57,880 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-24 16:05:57,883 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-24 16:05:57,885 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73399830, jitterRate=0.09374269843101501}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-24 16:05:57,888 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-24 16:05:57,899 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690214757737 2023-07-24 16:05:57,933 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-24 16:05:57,934 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-24 16:05:57,935 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33229,1690214755329, state=OPEN 2023-07-24 16:05:57,938 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-24 16:05:57,938 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-24 16:05:57,943 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-24 16:05:57,943 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33229,1690214755329 in 392 msec 2023-07-24 16:05:57,951 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-24 16:05:57,951 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 635 msec 2023-07-24 16:05:57,957 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1000 sec 2023-07-24 16:05:57,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690214757957, completionTime=-1 2023-07-24 16:05:57,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-24 16:05:57,958 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-24 16:05:58,040 DEBUG [hconnection-0x26dbae7d-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:05:58,048 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34490, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:05:58,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-24 16:05:58,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690214818078 2023-07-24 16:05:58,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690214878078 2023-07-24 16:05:58,078 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 120 msec 2023-07-24 16:05:58,114 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43489,1690214753588-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:58,114 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43489,1690214753588-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:58,114 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43489,1690214753588-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:58,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:43489, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:58,119 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-24 16:05:58,132 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-24 16:05:58,148 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-24 16:05:58,149 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 16:05:58,162 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-24 16:05:58,165 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 16:05:58,175 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 16:05:58,207 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/hbase/namespace/9a519ef3c23975337d1ead4c50ddd583 2023-07-24 16:05:58,210 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/hbase/namespace/9a519ef3c23975337d1ead4c50ddd583 empty. 2023-07-24 16:05:58,211 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/hbase/namespace/9a519ef3c23975337d1ead4c50ddd583 2023-07-24 16:05:58,211 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-24 16:05:58,266 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-24 16:05:58,269 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9a519ef3c23975337d1ead4c50ddd583, NAME => 'hbase:namespace,,1690214758149.9a519ef3c23975337d1ead4c50ddd583.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp 2023-07-24 16:05:58,295 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690214758149.9a519ef3c23975337d1ead4c50ddd583.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:05:58,296 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 9a519ef3c23975337d1ead4c50ddd583, disabling compactions & flushes 2023-07-24 16:05:58,296 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690214758149.9a519ef3c23975337d1ead4c50ddd583. 2023-07-24 16:05:58,296 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690214758149.9a519ef3c23975337d1ead4c50ddd583. 2023-07-24 16:05:58,296 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690214758149.9a519ef3c23975337d1ead4c50ddd583. after waiting 0 ms 2023-07-24 16:05:58,296 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690214758149.9a519ef3c23975337d1ead4c50ddd583. 2023-07-24 16:05:58,296 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690214758149.9a519ef3c23975337d1ead4c50ddd583. 2023-07-24 16:05:58,296 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 9a519ef3c23975337d1ead4c50ddd583: 2023-07-24 16:05:58,301 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 16:05:58,319 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690214758149.9a519ef3c23975337d1ead4c50ddd583.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690214758304"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214758304"}]},"ts":"1690214758304"} 2023-07-24 16:05:58,350 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-24 16:05:58,352 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 16:05:58,358 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214758352"}]},"ts":"1690214758352"} 2023-07-24 16:05:58,364 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-24 16:05:58,368 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 16:05:58,369 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 16:05:58,369 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 16:05:58,369 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 16:05:58,369 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 16:05:58,372 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=9a519ef3c23975337d1ead4c50ddd583, ASSIGN}] 2023-07-24 16:05:58,376 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=9a519ef3c23975337d1ead4c50ddd583, ASSIGN 2023-07-24 16:05:58,378 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=9a519ef3c23975337d1ead4c50ddd583, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33053,1690214755222; forceNewPlan=false, retain=false 2023-07-24 16:05:58,531 INFO [jenkins-hbase4:43489] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 16:05:58,532 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=9a519ef3c23975337d1ead4c50ddd583, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:05:58,532 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690214758149.9a519ef3c23975337d1ead4c50ddd583.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690214758532"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214758532"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214758532"}]},"ts":"1690214758532"} 2023-07-24 16:05:58,542 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 9a519ef3c23975337d1ead4c50ddd583, server=jenkins-hbase4.apache.org,33053,1690214755222}] 2023-07-24 16:05:58,696 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:05:58,697 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 16:05:58,699 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59542, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 16:05:58,705 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690214758149.9a519ef3c23975337d1ead4c50ddd583. 2023-07-24 16:05:58,706 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9a519ef3c23975337d1ead4c50ddd583, NAME => 'hbase:namespace,,1690214758149.9a519ef3c23975337d1ead4c50ddd583.', STARTKEY => '', ENDKEY => ''} 2023-07-24 16:05:58,706 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690214758149.9a519ef3c23975337d1ead4c50ddd583. service=AccessControlService 2023-07-24 16:05:58,706 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 16:05:58,707 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 9a519ef3c23975337d1ead4c50ddd583 2023-07-24 16:05:58,707 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690214758149.9a519ef3c23975337d1ead4c50ddd583.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:05:58,707 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9a519ef3c23975337d1ead4c50ddd583 2023-07-24 16:05:58,707 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9a519ef3c23975337d1ead4c50ddd583 2023-07-24 16:05:58,709 INFO [StoreOpener-9a519ef3c23975337d1ead4c50ddd583-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 9a519ef3c23975337d1ead4c50ddd583 2023-07-24 16:05:58,712 DEBUG [StoreOpener-9a519ef3c23975337d1ead4c50ddd583-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/namespace/9a519ef3c23975337d1ead4c50ddd583/info 2023-07-24 16:05:58,712 DEBUG [StoreOpener-9a519ef3c23975337d1ead4c50ddd583-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/namespace/9a519ef3c23975337d1ead4c50ddd583/info 2023-07-24 16:05:58,713 INFO [StoreOpener-9a519ef3c23975337d1ead4c50ddd583-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9a519ef3c23975337d1ead4c50ddd583 columnFamilyName info 2023-07-24 16:05:58,713 INFO [StoreOpener-9a519ef3c23975337d1ead4c50ddd583-1] regionserver.HStore(310): Store=9a519ef3c23975337d1ead4c50ddd583/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 16:05:58,715 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/namespace/9a519ef3c23975337d1ead4c50ddd583 2023-07-24 16:05:58,716 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/namespace/9a519ef3c23975337d1ead4c50ddd583 2023-07-24 16:05:58,720 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9a519ef3c23975337d1ead4c50ddd583 2023-07-24 16:05:58,724 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/namespace/9a519ef3c23975337d1ead4c50ddd583/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 16:05:58,725 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9a519ef3c23975337d1ead4c50ddd583; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66567434, jitterRate=-0.008067935705184937}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 16:05:58,725 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9a519ef3c23975337d1ead4c50ddd583: 2023-07-24 16:05:58,727 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690214758149.9a519ef3c23975337d1ead4c50ddd583., pid=6, masterSystemTime=1690214758696 2023-07-24 16:05:58,732 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690214758149.9a519ef3c23975337d1ead4c50ddd583. 2023-07-24 16:05:58,732 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690214758149.9a519ef3c23975337d1ead4c50ddd583. 2023-07-24 16:05:58,735 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=9a519ef3c23975337d1ead4c50ddd583, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:05:58,735 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690214758149.9a519ef3c23975337d1ead4c50ddd583.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690214758734"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690214758734"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690214758734"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690214758734"}]},"ts":"1690214758734"} 2023-07-24 16:05:58,747 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-24 16:05:58,747 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 9a519ef3c23975337d1ead4c50ddd583, server=jenkins-hbase4.apache.org,33053,1690214755222 in 200 msec 2023-07-24 16:05:58,752 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-24 16:05:58,753 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=9a519ef3c23975337d1ead4c50ddd583, ASSIGN in 375 msec 2023-07-24 16:05:58,754 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 16:05:58,755 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214758754"}]},"ts":"1690214758754"} 2023-07-24 16:05:58,758 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-24 16:05:58,762 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 16:05:58,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-24 16:05:58,767 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 612 msec 2023-07-24 16:05:58,767 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-24 16:05:58,767 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 16:05:58,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:05:58,799 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59550, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:05:58,814 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-24 16:05:58,832 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-24 16:05:58,839 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 34 msec 2023-07-24 16:05:58,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-24 16:05:58,859 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-24 16:05:58,867 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-07-24 16:05:58,875 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-24 16:05:58,878 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-24 16:05:58,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.434sec 2023-07-24 16:05:58,882 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-24 16:05:58,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-24 16:05:58,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-24 16:05:58,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43489,1690214753588-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-24 16:05:58,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43489,1690214753588-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-24 16:05:58,910 DEBUG [Listener at localhost/34603] zookeeper.ReadOnlyZKClient(139): Connect 0x5356fd15 to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:05:58,913 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 16:05:58,916 DEBUG [Listener at localhost/34603] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ff4f668, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:05:58,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-24 16:05:58,918 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 16:05:58,922 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 16:05:58,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-24 16:05:58,933 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/hbase/acl/c835061443958a14d991915cd46995dd 2023-07-24 16:05:58,935 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/hbase/acl/c835061443958a14d991915cd46995dd empty. 2023-07-24 16:05:58,935 DEBUG [hconnection-0x50c81d15-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:05:58,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 16:05:58,939 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/hbase/acl/c835061443958a14d991915cd46995dd 2023-07-24 16:05:58,939 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-24 16:05:58,956 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34492, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:05:58,959 INFO [Listener at localhost/34603] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,43489,1690214753588 2023-07-24 16:05:58,959 INFO [Listener at localhost/34603] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-24 16:05:58,960 INFO [Listener at localhost/34603] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/test.cache.data in system properties and HBase conf 2023-07-24 16:05:58,960 INFO [Listener at localhost/34603] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/hadoop.tmp.dir in system properties and HBase conf 2023-07-24 16:05:58,960 INFO [Listener at localhost/34603] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/hadoop.log.dir in system properties and HBase conf 2023-07-24 16:05:58,960 INFO [Listener at localhost/34603] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-24 16:05:58,960 INFO [Listener at localhost/34603] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-24 16:05:58,960 INFO [Listener at localhost/34603] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-24 16:05:58,961 INFO [Listener at localhost/34603] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-24 16:05:58,961 INFO [Listener at localhost/34603] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-24 16:05:58,961 INFO [Listener at localhost/34603] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-24 16:05:58,961 INFO [Listener at localhost/34603] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 16:05:58,961 INFO [Listener at localhost/34603] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-24 16:05:58,961 INFO [Listener at localhost/34603] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-24 16:05:58,961 INFO [Listener at localhost/34603] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 16:05:58,961 INFO [Listener at localhost/34603] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 16:05:58,962 INFO [Listener at localhost/34603] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-24 16:05:58,962 INFO [Listener at localhost/34603] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/nfs.dump.dir in system properties and HBase conf 2023-07-24 16:05:58,963 INFO [Listener at localhost/34603] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/java.io.tmpdir in system properties and HBase conf 2023-07-24 16:05:58,963 INFO [Listener at localhost/34603] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 16:05:58,963 INFO [Listener at localhost/34603] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-24 16:05:58,964 INFO [Listener at localhost/34603] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-24 16:05:58,996 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-24 16:05:59,003 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => c835061443958a14d991915cd46995dd, NAME => 'hbase:acl,,1690214758906.c835061443958a14d991915cd46995dd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp 2023-07-24 16:05:59,042 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 16:05:59,066 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690214758906.c835061443958a14d991915cd46995dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:05:59,067 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing c835061443958a14d991915cd46995dd, disabling compactions & flushes 2023-07-24 16:05:59,067 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690214758906.c835061443958a14d991915cd46995dd. 2023-07-24 16:05:59,067 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690214758906.c835061443958a14d991915cd46995dd. 2023-07-24 16:05:59,067 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690214758906.c835061443958a14d991915cd46995dd. after waiting 0 ms 2023-07-24 16:05:59,067 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690214758906.c835061443958a14d991915cd46995dd. 2023-07-24 16:05:59,067 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1690214758906.c835061443958a14d991915cd46995dd. 2023-07-24 16:05:59,067 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for c835061443958a14d991915cd46995dd: 2023-07-24 16:05:59,082 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 16:05:59,083 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1690214758906.c835061443958a14d991915cd46995dd.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690214759083"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214759083"}]},"ts":"1690214759083"} 2023-07-24 16:05:59,086 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-24 16:05:59,088 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 16:05:59,089 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214759088"}]},"ts":"1690214759088"} 2023-07-24 16:05:59,095 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-24 16:05:59,105 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 16:05:59,107 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 16:05:59,107 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 16:05:59,107 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 16:05:59,107 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 16:05:59,107 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=c835061443958a14d991915cd46995dd, ASSIGN}] 2023-07-24 16:05:59,111 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=c835061443958a14d991915cd46995dd, ASSIGN 2023-07-24 16:05:59,119 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=c835061443958a14d991915cd46995dd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33229,1690214755329; forceNewPlan=false, retain=false 2023-07-24 16:05:59,243 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 16:05:59,269 INFO [jenkins-hbase4:43489] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 16:05:59,271 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=c835061443958a14d991915cd46995dd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:05:59,272 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1690214758906.c835061443958a14d991915cd46995dd.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690214759271"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214759271"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214759271"}]},"ts":"1690214759271"} 2023-07-24 16:05:59,276 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure c835061443958a14d991915cd46995dd, server=jenkins-hbase4.apache.org,33229,1690214755329}] 2023-07-24 16:05:59,441 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1690214758906.c835061443958a14d991915cd46995dd. 2023-07-24 16:05:59,442 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c835061443958a14d991915cd46995dd, NAME => 'hbase:acl,,1690214758906.c835061443958a14d991915cd46995dd.', STARTKEY => '', ENDKEY => ''} 2023-07-24 16:05:59,442 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690214758906.c835061443958a14d991915cd46995dd. service=AccessControlService 2023-07-24 16:05:59,442 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 16:05:59,443 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl c835061443958a14d991915cd46995dd 2023-07-24 16:05:59,443 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690214758906.c835061443958a14d991915cd46995dd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:05:59,443 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c835061443958a14d991915cd46995dd 2023-07-24 16:05:59,443 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c835061443958a14d991915cd46995dd 2023-07-24 16:05:59,446 INFO [StoreOpener-c835061443958a14d991915cd46995dd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region c835061443958a14d991915cd46995dd 2023-07-24 16:05:59,449 DEBUG [StoreOpener-c835061443958a14d991915cd46995dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/acl/c835061443958a14d991915cd46995dd/l 2023-07-24 16:05:59,449 DEBUG [StoreOpener-c835061443958a14d991915cd46995dd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/acl/c835061443958a14d991915cd46995dd/l 2023-07-24 16:05:59,450 INFO [StoreOpener-c835061443958a14d991915cd46995dd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c835061443958a14d991915cd46995dd columnFamilyName l 2023-07-24 16:05:59,454 INFO [StoreOpener-c835061443958a14d991915cd46995dd-1] regionserver.HStore(310): Store=c835061443958a14d991915cd46995dd/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 16:05:59,458 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/acl/c835061443958a14d991915cd46995dd 2023-07-24 16:05:59,461 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/acl/c835061443958a14d991915cd46995dd 2023-07-24 16:05:59,468 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c835061443958a14d991915cd46995dd 2023-07-24 16:05:59,479 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/acl/c835061443958a14d991915cd46995dd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 16:05:59,481 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c835061443958a14d991915cd46995dd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74482983, jitterRate=0.10988293588161469}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 16:05:59,481 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c835061443958a14d991915cd46995dd: 2023-07-24 16:05:59,486 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1690214758906.c835061443958a14d991915cd46995dd., pid=11, masterSystemTime=1690214759432 2023-07-24 16:05:59,490 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1690214758906.c835061443958a14d991915cd46995dd. 2023-07-24 16:05:59,490 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1690214758906.c835061443958a14d991915cd46995dd. 2023-07-24 16:05:59,492 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=c835061443958a14d991915cd46995dd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:05:59,492 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1690214758906.c835061443958a14d991915cd46995dd.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690214759491"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690214759491"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690214759491"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690214759491"}]},"ts":"1690214759491"} 2023-07-24 16:05:59,502 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-24 16:05:59,503 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure c835061443958a14d991915cd46995dd, server=jenkins-hbase4.apache.org,33229,1690214755329 in 219 msec 2023-07-24 16:05:59,508 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-24 16:05:59,508 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=c835061443958a14d991915cd46995dd, ASSIGN in 396 msec 2023-07-24 16:05:59,511 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 16:05:59,512 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214759511"}]},"ts":"1690214759511"} 2023-07-24 16:05:59,515 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-24 16:05:59,520 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 16:05:59,523 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 606 msec 2023-07-24 16:05:59,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 16:05:59,543 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-24 16:05:59,557 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-24 16:06:00,580 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 16:06:00,964 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 16:06:00,971 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_39941_jobhistory____.ui4juv/webapp 2023-07-24 16:06:01,139 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-24 16:06:01,139 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-24 16:06:01,139 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 16:06:01,143 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 16:06:01,235 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 16:06:01,594 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 16:06:02,156 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-24 16:06:02,203 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:39941 2023-07-24 16:06:03,414 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 16:06:03,656 WARN [Listener at jenkins-hbase4.apache.org/33401] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 16:06:03,744 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-24 16:06:03,747 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-24 16:06:03,748 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-24 16:06:03,785 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:06:03,785 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-24 16:06:03,786 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:06:03,786 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-24 16:06:03,786 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 16:06:03,786 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-24 16:06:03,787 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:06:03,787 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-24 16:06:03,787 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 16:06:03,787 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-24 16:06:03,790 WARN [Listener at jenkins-hbase4.apache.org/33401] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 16:06:03,790 INFO [Listener at jenkins-hbase4.apache.org/33401] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 16:06:03,801 INFO [Listener at jenkins-hbase4.apache.org/33401] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45237_cluster____44ykcv/webapp 2023-07-24 16:06:03,883 INFO [Listener at jenkins-hbase4.apache.org/33401] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 16:06:03,883 INFO [Listener at jenkins-hbase4.apache.org/33401] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-24 16:06:03,884 INFO [Listener at jenkins-hbase4.apache.org/33401] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 16:06:03,884 INFO [Listener at jenkins-hbase4.apache.org/33401] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 16:06:03,894 INFO [Listener at jenkins-hbase4.apache.org/33401] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 16:06:04,130 INFO [Listener at jenkins-hbase4.apache.org/33401] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 16:06:04,294 INFO [Listener at jenkins-hbase4.apache.org/33401] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 16:06:04,308 INFO [Listener at jenkins-hbase4.apache.org/33401] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45237 2023-07-24 16:06:04,846 WARN [Listener at jenkins-hbase4.apache.org/46305] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 16:06:04,877 WARN [Listener at jenkins-hbase4.apache.org/46305] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 16:06:04,878 INFO [Listener at jenkins-hbase4.apache.org/46305] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 16:06:04,888 INFO [Listener at jenkins-hbase4.apache.org/46305] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41913_node____.raa7us/webapp 2023-07-24 16:06:04,944 INFO [Listener at jenkins-hbase4.apache.org/46305] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-24 16:06:04,944 INFO [Listener at jenkins-hbase4.apache.org/46305] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 16:06:04,944 INFO [Listener at jenkins-hbase4.apache.org/46305] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 16:06:04,944 INFO [Listener at jenkins-hbase4.apache.org/46305] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 16:06:04,954 INFO [Listener at jenkins-hbase4.apache.org/46305] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 16:06:04,980 INFO [Listener at jenkins-hbase4.apache.org/46305] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 16:06:05,087 INFO [Listener at jenkins-hbase4.apache.org/46305] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 16:06:05,116 INFO [Listener at jenkins-hbase4.apache.org/46305] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41913 2023-07-24 16:06:05,465 WARN [Listener at jenkins-hbase4.apache.org/42941] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 16:06:05,473 WARN [Listener at jenkins-hbase4.apache.org/42941] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 16:06:05,473 INFO [Listener at jenkins-hbase4.apache.org/42941] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 16:06:05,480 INFO [Listener at jenkins-hbase4.apache.org/42941] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44919_node____cuxvxb/webapp 2023-07-24 16:06:05,546 INFO [Listener at jenkins-hbase4.apache.org/42941] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-24 16:06:05,547 INFO [Listener at jenkins-hbase4.apache.org/42941] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 16:06:05,547 INFO [Listener at jenkins-hbase4.apache.org/42941] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 16:06:05,547 INFO [Listener at jenkins-hbase4.apache.org/42941] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 16:06:05,557 INFO [Listener at jenkins-hbase4.apache.org/42941] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 16:06:05,580 INFO [Listener at jenkins-hbase4.apache.org/42941] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 16:06:05,666 INFO [Listener at jenkins-hbase4.apache.org/42941] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 16:06:05,674 INFO [Listener at jenkins-hbase4.apache.org/42941] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44919 2023-07-24 16:06:05,712 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-24 16:06:05,714 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 16:06:05,787 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=704, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=212, ProcessCount=174, AvailableMemoryMB=7744 2023-07-24 16:06:05,787 WARN [Listener at jenkins-hbase4.apache.org/42941] hbase.ResourceChecker(130): Thread=704 is superior to 500 2023-07-24 16:06:05,803 DEBUG [Listener at jenkins-hbase4.apache.org/42941] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-24 16:06:05,808 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57618, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-24 16:06:05,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 16:06:05,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-24 16:06:05,822 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 16:06:05,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-24 16:06:05,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 16:06:05,825 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 16:06:05,829 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportWithTargetName/78b4dc732c1fd48b9ec04a419e29bc06 2023-07-24 16:06:05,829 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportWithTargetName/641b7dd8fd78725b7834f7dd0ce7262a 2023-07-24 16:06:05,832 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportWithTargetName/78b4dc732c1fd48b9ec04a419e29bc06 empty. 2023-07-24 16:06:05,832 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportWithTargetName/641b7dd8fd78725b7834f7dd0ce7262a empty. 2023-07-24 16:06:05,833 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportWithTargetName/78b4dc732c1fd48b9ec04a419e29bc06 2023-07-24 16:06:05,833 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportWithTargetName/641b7dd8fd78725b7834f7dd0ce7262a 2023-07-24 16:06:05,833 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-24 16:06:05,884 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-24 16:06:05,887 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 78b4dc732c1fd48b9ec04a419e29bc06, NAME => 'testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp 2023-07-24 16:06:05,887 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 641b7dd8fd78725b7834f7dd0ce7262a, NAME => 'testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp 2023-07-24 16:06:05,931 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:06:05,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 16:06:05,932 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 78b4dc732c1fd48b9ec04a419e29bc06, disabling compactions & flushes 2023-07-24 16:06:05,933 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06. 2023-07-24 16:06:05,933 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06. 2023-07-24 16:06:05,933 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06. after waiting 0 ms 2023-07-24 16:06:05,933 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06. 2023-07-24 16:06:05,933 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06. 2023-07-24 16:06:05,933 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 78b4dc732c1fd48b9ec04a419e29bc06: 2023-07-24 16:06:05,938 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:06:05,938 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 641b7dd8fd78725b7834f7dd0ce7262a, disabling compactions & flushes 2023-07-24 16:06:05,938 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a. 2023-07-24 16:06:05,938 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a. 2023-07-24 16:06:05,938 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a. after waiting 0 ms 2023-07-24 16:06:05,938 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a. 2023-07-24 16:06:05,938 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a. 2023-07-24 16:06:05,938 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 641b7dd8fd78725b7834f7dd0ce7262a: 2023-07-24 16:06:05,945 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 16:06:05,949 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690214765949"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214765949"}]},"ts":"1690214765949"} 2023-07-24 16:06:05,949 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690214765949"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214765949"}]},"ts":"1690214765949"} 2023-07-24 16:06:06,006 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 16:06:06,008 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 16:06:06,008 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214766008"}]},"ts":"1690214766008"} 2023-07-24 16:06:06,012 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-24 16:06:06,018 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 16:06:06,021 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 16:06:06,022 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 16:06:06,022 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 16:06:06,022 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 16:06:06,022 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=78b4dc732c1fd48b9ec04a419e29bc06, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=641b7dd8fd78725b7834f7dd0ce7262a, ASSIGN}] 2023-07-24 16:06:06,026 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=78b4dc732c1fd48b9ec04a419e29bc06, ASSIGN 2023-07-24 16:06:06,026 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=641b7dd8fd78725b7834f7dd0ce7262a, ASSIGN 2023-07-24 16:06:06,029 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=78b4dc732c1fd48b9ec04a419e29bc06, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38047,1690214755282; forceNewPlan=false, retain=false 2023-07-24 16:06:06,029 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=641b7dd8fd78725b7834f7dd0ce7262a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33053,1690214755222; forceNewPlan=false, retain=false 2023-07-24 16:06:06,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 16:06:06,179 INFO [jenkins-hbase4:43489] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 16:06:06,182 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=78b4dc732c1fd48b9ec04a419e29bc06, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:06,182 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=641b7dd8fd78725b7834f7dd0ce7262a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:06,182 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690214766182"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214766182"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214766182"}]},"ts":"1690214766182"} 2023-07-24 16:06:06,182 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690214766182"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214766182"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214766182"}]},"ts":"1690214766182"} 2023-07-24 16:06:06,185 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 78b4dc732c1fd48b9ec04a419e29bc06, server=jenkins-hbase4.apache.org,38047,1690214755282}] 2023-07-24 16:06:06,186 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 641b7dd8fd78725b7834f7dd0ce7262a, server=jenkins-hbase4.apache.org,33053,1690214755222}] 2023-07-24 16:06:06,339 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:06,340 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 16:06:06,343 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60434, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 16:06:06,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a. 2023-07-24 16:06:06,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 641b7dd8fd78725b7834f7dd0ce7262a, NAME => 'testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 16:06:06,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a. service=AccessControlService 2023-07-24 16:06:06,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06. 2023-07-24 16:06:06,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 16:06:06,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 78b4dc732c1fd48b9ec04a419e29bc06, NAME => 'testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 16:06:06,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 641b7dd8fd78725b7834f7dd0ce7262a 2023-07-24 16:06:06,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:06:06,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06. service=AccessControlService 2023-07-24 16:06:06,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 641b7dd8fd78725b7834f7dd0ce7262a 2023-07-24 16:06:06,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 641b7dd8fd78725b7834f7dd0ce7262a 2023-07-24 16:06:06,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 16:06:06,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 78b4dc732c1fd48b9ec04a419e29bc06 2023-07-24 16:06:06,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:06:06,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 78b4dc732c1fd48b9ec04a419e29bc06 2023-07-24 16:06:06,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 78b4dc732c1fd48b9ec04a419e29bc06 2023-07-24 16:06:06,353 INFO [StoreOpener-78b4dc732c1fd48b9ec04a419e29bc06-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 78b4dc732c1fd48b9ec04a419e29bc06 2023-07-24 16:06:06,353 INFO [StoreOpener-641b7dd8fd78725b7834f7dd0ce7262a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 641b7dd8fd78725b7834f7dd0ce7262a 2023-07-24 16:06:06,355 DEBUG [StoreOpener-78b4dc732c1fd48b9ec04a419e29bc06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportWithTargetName/78b4dc732c1fd48b9ec04a419e29bc06/cf 2023-07-24 16:06:06,355 DEBUG [StoreOpener-78b4dc732c1fd48b9ec04a419e29bc06-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportWithTargetName/78b4dc732c1fd48b9ec04a419e29bc06/cf 2023-07-24 16:06:06,355 DEBUG [StoreOpener-641b7dd8fd78725b7834f7dd0ce7262a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportWithTargetName/641b7dd8fd78725b7834f7dd0ce7262a/cf 2023-07-24 16:06:06,355 DEBUG [StoreOpener-641b7dd8fd78725b7834f7dd0ce7262a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportWithTargetName/641b7dd8fd78725b7834f7dd0ce7262a/cf 2023-07-24 16:06:06,358 INFO [StoreOpener-78b4dc732c1fd48b9ec04a419e29bc06-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 78b4dc732c1fd48b9ec04a419e29bc06 columnFamilyName cf 2023-07-24 16:06:06,358 INFO [StoreOpener-641b7dd8fd78725b7834f7dd0ce7262a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 641b7dd8fd78725b7834f7dd0ce7262a columnFamilyName cf 2023-07-24 16:06:06,361 INFO [StoreOpener-641b7dd8fd78725b7834f7dd0ce7262a-1] regionserver.HStore(310): Store=641b7dd8fd78725b7834f7dd0ce7262a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 16:06:06,361 INFO [StoreOpener-78b4dc732c1fd48b9ec04a419e29bc06-1] regionserver.HStore(310): Store=78b4dc732c1fd48b9ec04a419e29bc06/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 16:06:06,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportWithTargetName/641b7dd8fd78725b7834f7dd0ce7262a 2023-07-24 16:06:06,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportWithTargetName/78b4dc732c1fd48b9ec04a419e29bc06 2023-07-24 16:06:06,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportWithTargetName/641b7dd8fd78725b7834f7dd0ce7262a 2023-07-24 16:06:06,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportWithTargetName/78b4dc732c1fd48b9ec04a419e29bc06 2023-07-24 16:06:06,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 78b4dc732c1fd48b9ec04a419e29bc06 2023-07-24 16:06:06,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 641b7dd8fd78725b7834f7dd0ce7262a 2023-07-24 16:06:06,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportWithTargetName/641b7dd8fd78725b7834f7dd0ce7262a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 16:06:06,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportWithTargetName/78b4dc732c1fd48b9ec04a419e29bc06/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 16:06:06,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 641b7dd8fd78725b7834f7dd0ce7262a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59015086, jitterRate=-0.1206066906452179}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 16:06:06,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 641b7dd8fd78725b7834f7dd0ce7262a: 2023-07-24 16:06:06,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 78b4dc732c1fd48b9ec04a419e29bc06; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59698990, jitterRate=-0.11041572690010071}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 16:06:06,383 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 78b4dc732c1fd48b9ec04a419e29bc06: 2023-07-24 16:06:06,384 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a., pid=16, masterSystemTime=1690214766339 2023-07-24 16:06:06,385 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06., pid=15, masterSystemTime=1690214766339 2023-07-24 16:06:06,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a. 2023-07-24 16:06:06,390 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a. 2023-07-24 16:06:06,392 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=641b7dd8fd78725b7834f7dd0ce7262a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:06,392 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690214766392"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690214766392"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690214766392"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690214766392"}]},"ts":"1690214766392"} 2023-07-24 16:06:06,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06. 2023-07-24 16:06:06,394 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06. 2023-07-24 16:06:06,397 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=78b4dc732c1fd48b9ec04a419e29bc06, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:06,401 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690214766397"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690214766397"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690214766397"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690214766397"}]},"ts":"1690214766397"} 2023-07-24 16:06:06,406 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-24 16:06:06,407 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 641b7dd8fd78725b7834f7dd0ce7262a, server=jenkins-hbase4.apache.org,33053,1690214755222 in 215 msec 2023-07-24 16:06:06,409 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-24 16:06:06,410 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 78b4dc732c1fd48b9ec04a419e29bc06, server=jenkins-hbase4.apache.org,38047,1690214755282 in 219 msec 2023-07-24 16:06:06,410 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=641b7dd8fd78725b7834f7dd0ce7262a, ASSIGN in 384 msec 2023-07-24 16:06:06,413 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-24 16:06:06,413 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=78b4dc732c1fd48b9ec04a419e29bc06, ASSIGN in 388 msec 2023-07-24 16:06:06,414 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 16:06:06,414 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214766414"}]},"ts":"1690214766414"} 2023-07-24 16:06:06,417 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-24 16:06:06,421 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 16:06:06,428 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-24 16:06:06,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 16:06:06,452 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33229] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 16:06:06,495 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 16:06:06,495 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 16:06:06,495 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 16:06:06,495 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 16:06:06,495 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 16:06:06,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 16:06:06,511 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 16:06:06,512 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 16:06:06,514 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 694 msec 2023-07-24 16:06:06,515 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 16:06:06,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 16:06:06,939 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-24 16:06:06,945 DEBUG [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-24 16:06:06,946 DEBUG [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06. 2023-07-24 16:06:06,948 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 16:06:06,974 DEBUG [hconnection-0x50c81d15-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:06:06,980 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60438, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:06:06,987 DEBUG [hconnection-0x50c81d15-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:06:06,990 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37330, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:06:07,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 16:06:07,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690214767005 (current time:1690214767005). 2023-07-24 16:06:07,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 16:06:07,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(139): Connect 0x7864a0f7 to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:06:07,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5bd7d557, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:06:07,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:06:07,016 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57414, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:06:07,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7864a0f7 to 127.0.0.1:49766 2023-07-24 16:06:07,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:06:07,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(139): Connect 0x054f55a7 to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:06:07,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3fd44d74, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:06:07,127 DEBUG [hconnection-0x4be710c6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:06:07,128 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57416, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:06:07,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x054f55a7 to 127.0.0.1:49766 2023-07-24 16:06:07,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:06:07,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 16:06:07,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 16:06:07,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 16:06:07,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 16:06:07,194 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 16:06:07,200 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690215367200 2023-07-24 16:06:07,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 16:06:07,200 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-24 16:06:07,205 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 16:06:07,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 16:06:07,208 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 22 msec 2023-07-24 16:06:07,209 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 16:06:07,210 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 16:06:07,210 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 16:06:07,210 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690215367210 2023-07-24 16:06:07,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,239 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-24 16:06:07,240 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:06:07,240 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-24 16:06:07,241 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-24 16:06:07,241 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,241 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,250 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:07,250 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:07,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:07,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:07,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:07,250 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,250 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:07,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:07,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:07,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:07,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,251 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,251 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,252 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,252 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,252 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,252 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,252 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 16:06:07,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 16:06:07,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 16:06:07,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 16:06:07,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,254 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 16:06:07,254 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 16:06:07,254 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 16:06:07,258 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,258 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,258 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,258 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 16:06:07,258 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:06:07,259 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 16:06:07,259 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 16:06:07,259 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 16:06:07,259 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33229,1690214755329' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 16:06:07,259 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 16:06:07,260 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:06:07,259 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:06:07,261 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 16:06:07,262 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 16:06:07,262 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 16:06:07,262 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 16:06:07,262 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38047,1690214755282' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 16:06:07,262 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33053,1690214755222' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 16:06:07,265 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,266 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,266 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:07,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:07,267 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,267 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,267 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,267 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:06:07,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:07,268 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,268 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:06:07,272 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,272 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:06:07,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:07,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:07,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:07,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33053,1690214755222' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-24 16:06:07,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c9cc1b3[Count = 1] remaining members to acquire global barrier 2023-07-24 16:06:07,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:07,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:07,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:07,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:07,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:07,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:07,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38047,1690214755282' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-24 16:06:07,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c9cc1b3[Count = 0] remaining members to acquire global barrier 2023-07-24 16:06:07,279 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-24 16:06:07,279 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,281 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,282 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,282 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 16:06:07,282 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 16:06:07,282 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 16:06:07,282 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33229,1690214755329' in zk 2023-07-24 16:06:07,283 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,283 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 16:06:07,283 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 16:06:07,283 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06. 2023-07-24 16:06:07,283 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,284 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 16:06:07,284 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,284 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 16:06:07,284 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 16:06:07,284 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 16:06:07,284 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a. 2023-07-24 16:06:07,284 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06. started... 2023-07-24 16:06:07,284 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a. started... 2023-07-24 16:06:07,287 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 16:06:07,287 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:06:07,287 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 16:06:07,290 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 78b4dc732c1fd48b9ec04a419e29bc06: 2023-07-24 16:06:07,290 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 641b7dd8fd78725b7834f7dd0ce7262a: 2023-07-24 16:06:07,291 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,291 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,296 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 16:06:07,296 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 16:06:07,300 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 16:06:07,300 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 16:06:07,310 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:06:07,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 16:06:07,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 16:06:07,316 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 16:06:07,335 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a. completed. 2023-07-24 16:06:07,335 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a. 2023-07-24 16:06:07,336 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 16:06:07,336 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 16:06:07,336 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,336 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 16:06:07,336 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33053,1690214755222' in zk 2023-07-24 16:06:07,338 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 16:06:07,338 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,338 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:06:07,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:07,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:07,338 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 16:06:07,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:07,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:07,342 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06. completed. 2023-07-24 16:06:07,342 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06. 2023-07-24 16:06:07,342 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 16:06:07,342 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 16:06:07,342 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,342 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 16:06:07,342 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38047,1690214755282' in zk 2023-07-24 16:06:07,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,344 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,344 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 16:06:07,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:07,344 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:06:07,344 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 16:06:07,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:07,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:07,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33053,1690214755222': 2023-07-24 16:06:07,350 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33053,1690214755222' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-24 16:06:07,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:07,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:07,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:07,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:07,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:07,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:07,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:07,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,38047,1690214755282': 2023-07-24 16:06:07,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38047,1690214755282' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-24 16:06:07,356 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-24 16:06:07,356 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 16:06:07,356 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 16:06:07,356 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,357 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 16:06:07,360 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,360 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,360 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:07,360 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,361 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:07,360 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:07,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:07,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:07,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:07,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:07,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:07,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:07,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,362 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:07,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,362 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:07,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:07,363 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:07,363 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:07,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:07,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,367 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:07,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,367 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:07,368 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:07,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,384 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,385 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:07,385 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:07,385 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:07,385 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:07,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:07,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:07,385 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:06:07,385 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,385 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:07,386 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-24 16:06:07,385 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:07,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:07,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,385 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 16:06:07,386 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:07,385 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:07,386 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:07,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:07,387 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,387 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:07,387 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:07,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:07,387 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:07,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:07,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:07,387 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:07,387 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,387 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 16:06:07,421 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,479 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,516 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:06:07,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 16:06:07,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 16:06:07,519 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 16:06:07,532 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-24 16:06:07,532 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,533 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:07,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690214767200Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1690214767421 (+221 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1690214767421Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1690214767422 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1690214767437 (+15 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1690214767466 (+29 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690214767532 (+66 ms) 2023-07-24 16:06:07,536 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 16:06:07,544 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 333 msec 2023-07-24 16:06:07,819 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:06:07,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 16:06:07,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 16:06:07,838 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38047] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 16:06:07,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33053] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 16:06:07,846 DEBUG [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-24 16:06:07,846 DEBUG [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06. 2023-07-24 16:06:07,847 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 16:06:07,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 16:06:07,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690214767867 (current time:1690214767867). 2023-07-24 16:06:07,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 16:06:07,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(139): Connect 0x2aed0168 to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:06:07,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7590f97, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:06:07,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:06:07,880 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57424, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:06:07,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2aed0168 to 127.0.0.1:49766 2023-07-24 16:06:07,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:06:07,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(139): Connect 0x0fe9e1e5 to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:06:07,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d4d4731, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:06:07,895 DEBUG [hconnection-0x2a7dcb8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:06:07,898 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57434, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:06:07,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0fe9e1e5 to 127.0.0.1:49766 2023-07-24 16:06:07,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:06:07,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 16:06:07,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 16:06:07,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 16:06:07,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 16:06:07,910 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 16:06:07,911 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690215367911 2023-07-24 16:06:07,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 16:06:07,911 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-24 16:06:07,913 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 16:06:07,913 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 16:06:07,913 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 16:06:07,914 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 16:06:07,916 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-07-24 16:06:07,917 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 16:06:07,918 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690215367918 2023-07-24 16:06:07,936 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-24 16:06:07,936 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-24 16:06:07,936 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:06:07,937 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-24 16:06:07,937 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-24 16:06:07,937 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,937 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,939 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:07,939 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:07,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:07,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:07,939 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,939 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:07,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:07,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:07,939 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:07,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:07,939 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,939 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,940 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,941 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,941 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 16:06:07,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 16:06:07,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 16:06:07,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 16:06:07,941 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 16:06:07,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,941 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 16:06:07,941 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 16:06:07,941 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 16:06:07,942 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 16:06:07,942 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:06:07,942 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 16:06:07,942 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 16:06:07,942 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:06:07,943 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 16:06:07,943 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 16:06:07,943 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 16:06:07,943 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 16:06:07,943 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33053,1690214755222' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 16:06:07,943 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 16:06:07,944 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 16:06:07,944 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33229,1690214755329' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 16:06:07,943 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:06:07,944 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 16:06:07,944 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 16:06:07,944 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38047,1690214755282' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 16:06:07,947 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,947 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:07,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:07,948 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,948 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,948 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,948 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:06:07,948 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:07,948 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,948 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:06:07,948 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,949 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:06:07,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:07,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 16:06:07,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:07,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:07,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33053,1690214755222' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-24 16:06:07,951 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49158143[Count = 1] remaining members to acquire global barrier 2023-07-24 16:06:07,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:07,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:07,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:07,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:07,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 16:06:07,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:07,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:07,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38047,1690214755282' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-24 16:06:07,953 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49158143[Count = 0] remaining members to acquire global barrier 2023-07-24 16:06:07,953 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-24 16:06:07,954 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,958 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,958 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,958 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,958 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 16:06:07,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 16:06:07,958 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 16:06:07,958 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:07,958 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a. 2023-07-24 16:06:07,958 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 16:06:07,958 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a. started... 2023-07-24 16:06:07,958 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 16:06:07,959 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 16:06:07,958 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 16:06:07,959 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:07,959 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 16:06:07,959 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33229,1690214755329' in zk 2023-07-24 16:06:07,959 INFO [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 641b7dd8fd78725b7834f7dd0ce7262a 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-24 16:06:07,959 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 16:06:07,959 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 16:06:07,959 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06. 2023-07-24 16:06:07,959 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06. started... 2023-07-24 16:06:07,959 INFO [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 78b4dc732c1fd48b9ec04a419e29bc06 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-24 16:06:07,961 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 16:06:07,961 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:06:07,962 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 16:06:08,013 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:06:08,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 16:06:08,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 16:06:08,015 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 16:06:08,106 INFO [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230724167733e4e3554f46b4215421f4b89b5c to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230724167733e4e3554f46b4215421f4b89b5c 2023-07-24 16:06:08,106 INFO [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307248d365c67083d45eeb8ebc96fbb4caa1c to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307248d365c67083d45eeb8ebc96fbb4caa1c 2023-07-24 16:06:08,159 INFO [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportWithTargetName/78b4dc732c1fd48b9ec04a419e29bc06/.tmp/cf/037bfce052c44765be16b5f203dc8da3 2023-07-24 16:06:08,171 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportWithTargetName/78b4dc732c1fd48b9ec04a419e29bc06/.tmp/cf/037bfce052c44765be16b5f203dc8da3 as hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportWithTargetName/78b4dc732c1fd48b9ec04a419e29bc06/cf/037bfce052c44765be16b5f203dc8da3 2023-07-24 16:06:08,185 INFO [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportWithTargetName/78b4dc732c1fd48b9ec04a419e29bc06/cf/037bfce052c44765be16b5f203dc8da3, entries=4, sequenceid=6, filesize=5.6 K 2023-07-24 16:06:08,187 INFO [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 78b4dc732c1fd48b9ec04a419e29bc06 in 228ms, sequenceid=6, compaction requested=false 2023-07-24 16:06:08,188 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-24 16:06:08,189 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 78b4dc732c1fd48b9ec04a419e29bc06: 2023-07-24 16:06:08,189 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 16:06:08,189 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 16:06:08,189 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportWithTargetName/78b4dc732c1fd48b9ec04a419e29bc06/cf/037bfce052c44765be16b5f203dc8da3] hfiles 2023-07-24 16:06:08,190 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportWithTargetName/78b4dc732c1fd48b9ec04a419e29bc06/cf/037bfce052c44765be16b5f203dc8da3 for snapshot=snaptb0-testExportWithTargetName 2023-07-24 16:06:08,215 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:06:08,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 16:06:08,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 16:06:08,223 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 16:06:08,232 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06. completed. 2023-07-24 16:06:08,232 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06. 2023-07-24 16:06:08,232 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 16:06:08,232 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 16:06:08,232 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:08,232 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 16:06:08,232 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,38047,1690214755282' in zk 2023-07-24 16:06:08,236 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:08,236 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 16:06:08,236 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:06:08,236 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 16:06:08,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:08,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:08,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:08,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:08,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:08,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 16:06:08,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:08,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:08,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:08,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:08,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 16:06:08,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:08,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:08,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,38047,1690214755282': 2023-07-24 16:06:08,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38047,1690214755282' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-24 16:06:08,523 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:06:08,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 16:06:08,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 16:06:08,525 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 16:06:08,556 INFO [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportWithTargetName/641b7dd8fd78725b7834f7dd0ce7262a/.tmp/cf/4a52ca3df2364f11af1b6db13526d31e 2023-07-24 16:06:08,566 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportWithTargetName/641b7dd8fd78725b7834f7dd0ce7262a/.tmp/cf/4a52ca3df2364f11af1b6db13526d31e as hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportWithTargetName/641b7dd8fd78725b7834f7dd0ce7262a/cf/4a52ca3df2364f11af1b6db13526d31e 2023-07-24 16:06:08,574 INFO [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportWithTargetName/641b7dd8fd78725b7834f7dd0ce7262a/cf/4a52ca3df2364f11af1b6db13526d31e, entries=46, sequenceid=6, filesize=12.6 K 2023-07-24 16:06:08,577 INFO [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 641b7dd8fd78725b7834f7dd0ce7262a in 618ms, sequenceid=6, compaction requested=false 2023-07-24 16:06:08,579 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 641b7dd8fd78725b7834f7dd0ce7262a: 2023-07-24 16:06:08,579 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 16:06:08,579 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 16:06:08,579 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportWithTargetName/641b7dd8fd78725b7834f7dd0ce7262a/cf/4a52ca3df2364f11af1b6db13526d31e] hfiles 2023-07-24 16:06:08,579 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportWithTargetName/641b7dd8fd78725b7834f7dd0ce7262a/cf/4a52ca3df2364f11af1b6db13526d31e for snapshot=snaptb0-testExportWithTargetName 2023-07-24 16:06:08,597 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a. completed. 2023-07-24 16:06:08,597 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a. 2023-07-24 16:06:08,597 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 16:06:08,598 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 16:06:08,598 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:08,598 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 16:06:08,598 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33053,1690214755222' in zk 2023-07-24 16:06:08,600 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 16:06:08,600 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:08,601 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:06:08,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:08,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:08,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:08,601 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 16:06:08,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:08,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:08,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 16:06:08,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:08,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:08,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:08,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:08,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 16:06:08,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:08,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:08,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:08,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33053,1690214755222': 2023-07-24 16:06:08,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33053,1690214755222' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-24 16:06:08,605 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-24 16:06:08,605 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 16:06:08,605 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 16:06:08,605 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-24 16:06:08,605 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 16:06:08,607 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 16:06:08,607 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 16:06:08,607 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:08,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 16:06:08,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:08,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:08,607 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 16:06:08,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 16:06:08,607 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 16:06:08,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 16:06:08,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 16:06:08,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 16:06:08,608 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:08,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:08,608 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:08,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 16:06:08,608 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:08,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:08,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:08,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:08,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 16:06:08,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:08,609 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:08,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 16:06:08,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 16:06:08,609 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:08,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:08,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 16:06:08,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:08,609 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:08,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 16:06:08,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:08,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:08,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 16:06:08,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:08,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:08,615 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:08,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 16:06:08,616 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:08,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:08,616 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:08,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:08,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:08,627 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:08,627 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:08,627 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:08,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:08,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:08,627 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:08,627 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 16:06:08,628 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:08,628 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:08,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:08,628 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:06:08,628 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-24 16:06:08,628 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:08,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:08,628 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:08,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:08,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:08,629 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-24 16:06:08,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:08,628 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:08,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 16:06:08,629 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 16:06:08,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 16:06:08,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:08,629 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:08,630 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:08,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:08,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:08,630 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 16:06:08,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:08,630 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:08,630 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:08,630 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 16:06:08,631 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 16:06:08,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307248d365c67083d45eeb8ebc96fbb4caa1c, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230724167733e4e3554f46b4215421f4b89b5c] mob files 2023-07-24 16:06:08,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307248d365c67083d45eeb8ebc96fbb4caa1c 2023-07-24 16:06:08,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230724167733e4e3554f46b4215421f4b89b5c 2023-07-24 16:06:08,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-24 16:06:08,650 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 16:06:08,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-24 16:06:08,725 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-24 16:06:08,725 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 16:06:08,725 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 16:06:08,725 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690214767911Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1690214768648 (+737 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1690214768649 (+1 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1690214768649Writing data manifest for snaptb0-testExportWithTargetName at 1690214768656 (+7 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1690214768675 (+19 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690214768725 (+50 ms) 2023-07-24 16:06:08,728 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 16:06:08,731 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 817 msec 2023-07-24 16:06:09,025 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:06:09,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 16:06:09,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 16:06:09,030 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214769029 2023-07-24 16:06:09,030 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:32943, tgtDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214769029, rawTgtDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214769029, srcFsUri=hdfs://localhost:32943, srcDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0 2023-07-24 16:06:09,070 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:32943, inputRoot=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0 2023-07-24 16:06:09,071 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1755830524_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214769029, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214769029/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-24 16:06:09,071 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:32943, inputRoot=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0, snapshotDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-24 16:06:09,094 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214769029/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-24 16:06:09,223 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:09,223 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:09,224 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:09,224 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:10,392 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/hadoop-611557736577517883.jar 2023-07-24 16:06:10,393 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:10,393 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:10,484 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/hadoop-8794160792738206005.jar 2023-07-24 16:06:10,485 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:10,485 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:10,486 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:10,486 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:10,487 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:10,487 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:10,488 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 16:06:10,488 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 16:06:10,489 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 16:06:10,490 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 16:06:10,490 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 16:06:10,491 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 16:06:10,491 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 16:06:10,492 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 16:06:10,492 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 16:06:10,493 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 16:06:10,498 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:06:10,498 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:06:10,499 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 16:06:10,499 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:06:10,499 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:06:10,500 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 16:06:10,500 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 16:06:11,379 WARN [Listener at jenkins-hbase4.apache.org/42941] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 16:06:11,385 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-24 16:06:11,395 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-24 16:06:11,876 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 16:06:11,905 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 16:06:11,905 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 16:06:12,519 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0001_000001 (auth:SIMPLE) 2023-07-24 16:06:17,725 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0001_000001 (auth:SIMPLE) 2023-07-24 16:06:20,034 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0001_000001 (auth:SIMPLE) 2023-07-24 16:06:23,172 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0001_000001 (auth:SIMPLE) 2023-07-24 16:06:24,303 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 16:06:24,306 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 16:06:24,317 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-24 16:06:24,317 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 16:06:24,318 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 16:06:24,318 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-526159531_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-24 16:06:24,319 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-24 16:06:24,319 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-24 16:06:24,319 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-526159531_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214769029/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214769029/.hbase-snapshot/testExportWithTargetName 2023-07-24 16:06:24,320 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214769029/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-24 16:06:24,320 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214769029/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-24 16:06:24,332 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-24 16:06:24,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-24 16:06:24,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-24 16:06:24,350 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214784350"}]},"ts":"1690214784350"} 2023-07-24 16:06:24,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 16:06:24,352 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-24 16:06:24,354 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-24 16:06:24,356 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=78b4dc732c1fd48b9ec04a419e29bc06, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=641b7dd8fd78725b7834f7dd0ce7262a, UNASSIGN}] 2023-07-24 16:06:24,358 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=78b4dc732c1fd48b9ec04a419e29bc06, UNASSIGN 2023-07-24 16:06:24,358 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=641b7dd8fd78725b7834f7dd0ce7262a, UNASSIGN 2023-07-24 16:06:24,359 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=78b4dc732c1fd48b9ec04a419e29bc06, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:24,359 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=641b7dd8fd78725b7834f7dd0ce7262a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:24,359 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690214784359"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214784359"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214784359"}]},"ts":"1690214784359"} 2023-07-24 16:06:24,359 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690214784359"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214784359"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214784359"}]},"ts":"1690214784359"} 2023-07-24 16:06:24,361 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 78b4dc732c1fd48b9ec04a419e29bc06, server=jenkins-hbase4.apache.org,38047,1690214755282}] 2023-07-24 16:06:24,363 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 641b7dd8fd78725b7834f7dd0ce7262a, server=jenkins-hbase4.apache.org,33053,1690214755222}] 2023-07-24 16:06:24,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 16:06:24,522 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 641b7dd8fd78725b7834f7dd0ce7262a 2023-07-24 16:06:24,522 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 78b4dc732c1fd48b9ec04a419e29bc06 2023-07-24 16:06:24,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 641b7dd8fd78725b7834f7dd0ce7262a, disabling compactions & flushes 2023-07-24 16:06:24,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 78b4dc732c1fd48b9ec04a419e29bc06, disabling compactions & flushes 2023-07-24 16:06:24,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a. 2023-07-24 16:06:24,523 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06. 2023-07-24 16:06:24,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a. 2023-07-24 16:06:24,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06. 2023-07-24 16:06:24,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a. after waiting 0 ms 2023-07-24 16:06:24,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a. 2023-07-24 16:06:24,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06. after waiting 0 ms 2023-07-24 16:06:24,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06. 2023-07-24 16:06:24,539 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportWithTargetName/78b4dc732c1fd48b9ec04a419e29bc06/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 16:06:24,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:06:24,540 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportWithTargetName/641b7dd8fd78725b7834f7dd0ce7262a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 16:06:24,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06. 2023-07-24 16:06:24,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 78b4dc732c1fd48b9ec04a419e29bc06: 2023-07-24 16:06:24,542 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:06:24,543 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a. 2023-07-24 16:06:24,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 641b7dd8fd78725b7834f7dd0ce7262a: 2023-07-24 16:06:24,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 78b4dc732c1fd48b9ec04a419e29bc06 2023-07-24 16:06:24,546 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=78b4dc732c1fd48b9ec04a419e29bc06, regionState=CLOSED 2023-07-24 16:06:24,546 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690214784546"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214784546"}]},"ts":"1690214784546"} 2023-07-24 16:06:24,547 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 641b7dd8fd78725b7834f7dd0ce7262a 2023-07-24 16:06:24,547 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=641b7dd8fd78725b7834f7dd0ce7262a, regionState=CLOSED 2023-07-24 16:06:24,548 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690214784547"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214784547"}]},"ts":"1690214784547"} 2023-07-24 16:06:24,552 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-24 16:06:24,552 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 78b4dc732c1fd48b9ec04a419e29bc06, server=jenkins-hbase4.apache.org,38047,1690214755282 in 187 msec 2023-07-24 16:06:24,553 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-24 16:06:24,553 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 641b7dd8fd78725b7834f7dd0ce7262a, server=jenkins-hbase4.apache.org,33053,1690214755222 in 187 msec 2023-07-24 16:06:24,554 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=78b4dc732c1fd48b9ec04a419e29bc06, UNASSIGN in 196 msec 2023-07-24 16:06:24,555 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-24 16:06:24,556 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=641b7dd8fd78725b7834f7dd0ce7262a, UNASSIGN in 197 msec 2023-07-24 16:06:24,557 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214784556"}]},"ts":"1690214784556"} 2023-07-24 16:06:24,558 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-24 16:06:24,560 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-24 16:06:24,562 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 221 msec 2023-07-24 16:06:24,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 16:06:24,655 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-24 16:06:24,661 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-24 16:06:24,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 16:06:24,672 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 16:06:24,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-24 16:06:24,675 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 16:06:24,686 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33229] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-24 16:06:24,690 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 16:06:24,690 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 16:06:24,690 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 16:06:24,690 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 16:06:24,691 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportWithTargetName/641b7dd8fd78725b7834f7dd0ce7262a 2023-07-24 16:06:24,693 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:06:24,693 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 16:06:24,693 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:06:24,693 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 16:06:24,693 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 16:06:24,693 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 16:06:24,693 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:06:24,693 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 16:06:24,693 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 16:06:24,693 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:06:24,693 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 16:06:24,695 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 16:06:24,696 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportWithTargetName/641b7dd8fd78725b7834f7dd0ce7262a/cf, FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportWithTargetName/641b7dd8fd78725b7834f7dd0ce7262a/recovered.edits] 2023-07-24 16:06:24,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-24 16:06:24,698 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportWithTargetName/78b4dc732c1fd48b9ec04a419e29bc06 2023-07-24 16:06:24,702 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportWithTargetName/78b4dc732c1fd48b9ec04a419e29bc06/cf, FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportWithTargetName/78b4dc732c1fd48b9ec04a419e29bc06/recovered.edits] 2023-07-24 16:06:24,705 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportWithTargetName/641b7dd8fd78725b7834f7dd0ce7262a/cf/4a52ca3df2364f11af1b6db13526d31e to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportWithTargetName/641b7dd8fd78725b7834f7dd0ce7262a/cf/4a52ca3df2364f11af1b6db13526d31e 2023-07-24 16:06:24,708 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportWithTargetName/78b4dc732c1fd48b9ec04a419e29bc06/cf/037bfce052c44765be16b5f203dc8da3 to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportWithTargetName/78b4dc732c1fd48b9ec04a419e29bc06/cf/037bfce052c44765be16b5f203dc8da3 2023-07-24 16:06:24,710 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportWithTargetName/641b7dd8fd78725b7834f7dd0ce7262a/recovered.edits/9.seqid to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportWithTargetName/641b7dd8fd78725b7834f7dd0ce7262a/recovered.edits/9.seqid 2023-07-24 16:06:24,715 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportWithTargetName/641b7dd8fd78725b7834f7dd0ce7262a 2023-07-24 16:06:24,717 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportWithTargetName/78b4dc732c1fd48b9ec04a419e29bc06/recovered.edits/9.seqid to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportWithTargetName/78b4dc732c1fd48b9ec04a419e29bc06/recovered.edits/9.seqid 2023-07-24 16:06:24,717 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportWithTargetName/78b4dc732c1fd48b9ec04a419e29bc06 2023-07-24 16:06:24,717 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-24 16:06:24,718 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-24 16:06:24,719 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-24 16:06:24,723 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307248d365c67083d45eeb8ebc96fbb4caa1c to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307248d365c67083d45eeb8ebc96fbb4caa1c 2023-07-24 16:06:24,725 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230724167733e4e3554f46b4215421f4b89b5c to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230724167733e4e3554f46b4215421f4b89b5c 2023-07-24 16:06:24,725 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-24 16:06:24,728 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 16:06:24,759 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-24 16:06:24,763 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-24 16:06:24,765 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 16:06:24,765 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-24 16:06:24,766 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690214784766"}]},"ts":"9223372036854775807"} 2023-07-24 16:06:24,766 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690214784766"}]},"ts":"9223372036854775807"} 2023-07-24 16:06:24,769 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 16:06:24,769 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 78b4dc732c1fd48b9ec04a419e29bc06, NAME => 'testtb-testExportWithTargetName,,1690214765815.78b4dc732c1fd48b9ec04a419e29bc06.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 641b7dd8fd78725b7834f7dd0ce7262a, NAME => 'testtb-testExportWithTargetName,1,1690214765815.641b7dd8fd78725b7834f7dd0ce7262a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 16:06:24,769 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-24 16:06:24,769 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690214784769"}]},"ts":"9223372036854775807"} 2023-07-24 16:06:24,772 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-24 16:06:24,777 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 16:06:24,780 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 115 msec 2023-07-24 16:06:24,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-24 16:06:24,800 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-24 16:06:24,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-24 16:06:24,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-24 16:06:24,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-24 16:06:24,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-24 16:06:24,871 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=751 (was 704) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/cluster_b8887cf5-a132-099c-754f-127401d6508d/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x26dbae7d-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: (jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/cluster_b8887cf5-a132-099c-754f-127401d6508d/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/cluster_b8887cf5-a132-099c-754f-127401d6508d/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/cluster_b8887cf5-a132-099c-754f-127401d6508d/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-526159531_17 at /127.0.0.1:57624 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1318 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/cluster_b8887cf5-a132-099c-754f-127401d6508d/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:33411 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-526159531_17 at /127.0.0.1:34196 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x26dbae7d-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1755830524_17 at /127.0.0.1:32928 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x26dbae7d-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/cluster_b8887cf5-a132-099c-754f-127401d6508d/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x26dbae7d-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1888473787_1 at /127.0.0.1:57604 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:35113 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=919 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=364 (was 212) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=6145 (was 7744) 2023-07-24 16:06:24,871 WARN [Listener at jenkins-hbase4.apache.org/42941] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-24 16:06:24,903 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=751, OpenFileDescriptor=919, MaxFileDescriptor=60000, SystemLoadAverage=364, ProcessCount=179, AvailableMemoryMB=6144 2023-07-24 16:06:24,903 WARN [Listener at jenkins-hbase4.apache.org/42941] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-24 16:06:24,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 16:06:24,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-24 16:06:24,912 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 16:06:24,913 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-24 16:06:24,914 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 16:06:24,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 16:06:24,919 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemState/43fdafeb0b3edd45e786f5bf598bc504 2023-07-24 16:06:24,919 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemState/7096bd1527743e9b459aa76d9879eed0 2023-07-24 16:06:24,920 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemState/7096bd1527743e9b459aa76d9879eed0 empty. 2023-07-24 16:06:24,920 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemState/43fdafeb0b3edd45e786f5bf598bc504 empty. 2023-07-24 16:06:24,920 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemState/7096bd1527743e9b459aa76d9879eed0 2023-07-24 16:06:24,921 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemState/43fdafeb0b3edd45e786f5bf598bc504 2023-07-24 16:06:24,921 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-24 16:06:24,938 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-24 16:06:24,940 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 43fdafeb0b3edd45e786f5bf598bc504, NAME => 'testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp 2023-07-24 16:06:24,940 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7096bd1527743e9b459aa76d9879eed0, NAME => 'testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp 2023-07-24 16:06:24,958 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:06:24,958 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 7096bd1527743e9b459aa76d9879eed0, disabling compactions & flushes 2023-07-24 16:06:24,958 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0. 2023-07-24 16:06:24,958 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0. 2023-07-24 16:06:24,958 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0. after waiting 0 ms 2023-07-24 16:06:24,958 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0. 2023-07-24 16:06:24,958 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0. 2023-07-24 16:06:24,958 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 7096bd1527743e9b459aa76d9879eed0: 2023-07-24 16:06:24,959 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:06:24,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 43fdafeb0b3edd45e786f5bf598bc504, disabling compactions & flushes 2023-07-24 16:06:24,960 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504. 2023-07-24 16:06:24,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504. 2023-07-24 16:06:24,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504. after waiting 0 ms 2023-07-24 16:06:24,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504. 2023-07-24 16:06:24,960 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504. 2023-07-24 16:06:24,960 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 43fdafeb0b3edd45e786f5bf598bc504: 2023-07-24 16:06:24,963 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 16:06:24,964 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690214784964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214784964"}]},"ts":"1690214784964"} 2023-07-24 16:06:24,964 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690214784964"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214784964"}]},"ts":"1690214784964"} 2023-07-24 16:06:24,967 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 16:06:24,968 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 16:06:24,968 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214784968"}]},"ts":"1690214784968"} 2023-07-24 16:06:24,970 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-24 16:06:24,974 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 16:06:24,975 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 16:06:24,975 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 16:06:24,975 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 16:06:24,975 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 16:06:24,975 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=43fdafeb0b3edd45e786f5bf598bc504, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7096bd1527743e9b459aa76d9879eed0, ASSIGN}] 2023-07-24 16:06:24,978 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7096bd1527743e9b459aa76d9879eed0, ASSIGN 2023-07-24 16:06:24,978 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=43fdafeb0b3edd45e786f5bf598bc504, ASSIGN 2023-07-24 16:06:24,980 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7096bd1527743e9b459aa76d9879eed0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33053,1690214755222; forceNewPlan=false, retain=false 2023-07-24 16:06:24,980 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=43fdafeb0b3edd45e786f5bf598bc504, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33229,1690214755329; forceNewPlan=false, retain=false 2023-07-24 16:06:25,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 16:06:25,130 INFO [jenkins-hbase4:43489] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 16:06:25,133 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=43fdafeb0b3edd45e786f5bf598bc504, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,133 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=7096bd1527743e9b459aa76d9879eed0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,134 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690214785133"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214785133"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214785133"}]},"ts":"1690214785133"} 2023-07-24 16:06:25,134 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690214785133"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214785133"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214785133"}]},"ts":"1690214785133"} 2023-07-24 16:06:25,144 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 7096bd1527743e9b459aa76d9879eed0, server=jenkins-hbase4.apache.org,33053,1690214755222}] 2023-07-24 16:06:25,147 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 43fdafeb0b3edd45e786f5bf598bc504, server=jenkins-hbase4.apache.org,33229,1690214755329}] 2023-07-24 16:06:25,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 16:06:25,307 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0. 2023-07-24 16:06:25,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7096bd1527743e9b459aa76d9879eed0, NAME => 'testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 16:06:25,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0. service=AccessControlService 2023-07-24 16:06:25,309 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 16:06:25,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 7096bd1527743e9b459aa76d9879eed0 2023-07-24 16:06:25,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:06:25,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7096bd1527743e9b459aa76d9879eed0 2023-07-24 16:06:25,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7096bd1527743e9b459aa76d9879eed0 2023-07-24 16:06:25,313 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504. 2023-07-24 16:06:25,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 43fdafeb0b3edd45e786f5bf598bc504, NAME => 'testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 16:06:25,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504. service=AccessControlService 2023-07-24 16:06:25,315 INFO [StoreOpener-7096bd1527743e9b459aa76d9879eed0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7096bd1527743e9b459aa76d9879eed0 2023-07-24 16:06:25,315 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 16:06:25,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 43fdafeb0b3edd45e786f5bf598bc504 2023-07-24 16:06:25,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:06:25,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 43fdafeb0b3edd45e786f5bf598bc504 2023-07-24 16:06:25,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 43fdafeb0b3edd45e786f5bf598bc504 2023-07-24 16:06:25,317 DEBUG [StoreOpener-7096bd1527743e9b459aa76d9879eed0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemState/7096bd1527743e9b459aa76d9879eed0/cf 2023-07-24 16:06:25,317 DEBUG [StoreOpener-7096bd1527743e9b459aa76d9879eed0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemState/7096bd1527743e9b459aa76d9879eed0/cf 2023-07-24 16:06:25,317 INFO [StoreOpener-43fdafeb0b3edd45e786f5bf598bc504-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 43fdafeb0b3edd45e786f5bf598bc504 2023-07-24 16:06:25,317 INFO [StoreOpener-7096bd1527743e9b459aa76d9879eed0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7096bd1527743e9b459aa76d9879eed0 columnFamilyName cf 2023-07-24 16:06:25,328 INFO [StoreOpener-7096bd1527743e9b459aa76d9879eed0-1] regionserver.HStore(310): Store=7096bd1527743e9b459aa76d9879eed0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 16:06:25,329 DEBUG [StoreOpener-43fdafeb0b3edd45e786f5bf598bc504-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemState/43fdafeb0b3edd45e786f5bf598bc504/cf 2023-07-24 16:06:25,331 DEBUG [StoreOpener-43fdafeb0b3edd45e786f5bf598bc504-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemState/43fdafeb0b3edd45e786f5bf598bc504/cf 2023-07-24 16:06:25,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemState/7096bd1527743e9b459aa76d9879eed0 2023-07-24 16:06:25,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemState/7096bd1527743e9b459aa76d9879eed0 2023-07-24 16:06:25,332 INFO [StoreOpener-43fdafeb0b3edd45e786f5bf598bc504-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 43fdafeb0b3edd45e786f5bf598bc504 columnFamilyName cf 2023-07-24 16:06:25,333 INFO [StoreOpener-43fdafeb0b3edd45e786f5bf598bc504-1] regionserver.HStore(310): Store=43fdafeb0b3edd45e786f5bf598bc504/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 16:06:25,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemState/43fdafeb0b3edd45e786f5bf598bc504 2023-07-24 16:06:25,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemState/43fdafeb0b3edd45e786f5bf598bc504 2023-07-24 16:06:25,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7096bd1527743e9b459aa76d9879eed0 2023-07-24 16:06:25,342 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 43fdafeb0b3edd45e786f5bf598bc504 2023-07-24 16:06:25,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemState/7096bd1527743e9b459aa76d9879eed0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 16:06:25,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemState/43fdafeb0b3edd45e786f5bf598bc504/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 16:06:25,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7096bd1527743e9b459aa76d9879eed0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73300777, jitterRate=0.09226669371128082}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 16:06:25,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7096bd1527743e9b459aa76d9879eed0: 2023-07-24 16:06:25,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 43fdafeb0b3edd45e786f5bf598bc504; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71748224, jitterRate=0.06913185119628906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 16:06:25,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 43fdafeb0b3edd45e786f5bf598bc504: 2023-07-24 16:06:25,345 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0., pid=30, masterSystemTime=1690214785300 2023-07-24 16:06:25,346 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504., pid=31, masterSystemTime=1690214785303 2023-07-24 16:06:25,348 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0. 2023-07-24 16:06:25,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0. 2023-07-24 16:06:25,349 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=7096bd1527743e9b459aa76d9879eed0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504. 2023-07-24 16:06:25,349 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504. 2023-07-24 16:06:25,350 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=43fdafeb0b3edd45e786f5bf598bc504, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,350 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690214785350"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690214785350"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690214785350"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690214785350"}]},"ts":"1690214785350"} 2023-07-24 16:06:25,350 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690214785348"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690214785348"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690214785348"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690214785348"}]},"ts":"1690214785348"} 2023-07-24 16:06:25,355 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-24 16:06:25,357 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 43fdafeb0b3edd45e786f5bf598bc504, server=jenkins-hbase4.apache.org,33229,1690214755329 in 205 msec 2023-07-24 16:06:25,358 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-24 16:06:25,362 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 7096bd1527743e9b459aa76d9879eed0, server=jenkins-hbase4.apache.org,33053,1690214755222 in 209 msec 2023-07-24 16:06:25,363 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=43fdafeb0b3edd45e786f5bf598bc504, ASSIGN in 382 msec 2023-07-24 16:06:25,364 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-24 16:06:25,365 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7096bd1527743e9b459aa76d9879eed0, ASSIGN in 383 msec 2023-07-24 16:06:25,366 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 16:06:25,366 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214785366"}]},"ts":"1690214785366"} 2023-07-24 16:06:25,368 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-24 16:06:25,371 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 16:06:25,371 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-24 16:06:25,374 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33229] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 16:06:25,376 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:06:25,376 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:06:25,376 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:06:25,376 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:06:25,378 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 16:06:25,378 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 16:06:25,378 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 16:06:25,378 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 16:06:25,381 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 471 msec 2023-07-24 16:06:25,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 16:06:25,521 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-24 16:06:25,524 DEBUG [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-24 16:06:25,524 DEBUG [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504. 2023-07-24 16:06:25,527 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 16:06:25,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 16:06:25,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690214785542 (current time:1690214785542). 2023-07-24 16:06:25,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 16:06:25,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(139): Connect 0x65abf51b to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:06:25,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@349b520c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:06:25,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:06:25,556 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50208, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:06:25,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65abf51b to 127.0.0.1:49766 2023-07-24 16:06:25,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:06:25,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(139): Connect 0x67cd5ae8 to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:06:25,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d746827, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:06:25,566 DEBUG [hconnection-0x33115ab7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:06:25,569 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50218, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:06:25,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67cd5ae8 to 127.0.0.1:49766 2023-07-24 16:06:25,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:06:25,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 16:06:25,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 16:06:25,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 16:06:25,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 16:06:25,580 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 16:06:25,581 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690215385581 2023-07-24 16:06:25,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 16:06:25,582 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-24 16:06:25,583 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 16:06:25,583 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 16:06:25,585 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 16:06:25,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 16:06:25,588 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-24 16:06:25,589 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 16:06:25,590 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690215385590 2023-07-24 16:06:25,605 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,605 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-24 16:06:25,605 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:06:25,607 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-24 16:06:25,607 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-24 16:06:25,607 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,607 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,609 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:25,609 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:25,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:25,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:25,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:25,609 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:25,609 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:25,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:25,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:25,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,610 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,610 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,611 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,611 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 16:06:25,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 16:06:25,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 16:06:25,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,611 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 16:06:25,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 16:06:25,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,611 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 16:06:25,611 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 16:06:25,612 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,612 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,612 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 16:06:25,612 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,612 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:06:25,612 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 16:06:25,612 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:06:25,612 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 16:06:25,614 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 16:06:25,614 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 16:06:25,614 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:06:25,613 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 16:06:25,615 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 16:06:25,615 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 16:06:25,615 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38047,1690214755282' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 16:06:25,614 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33229,1690214755329' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 16:06:25,615 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 16:06:25,615 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33053,1690214755222' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 16:06:25,620 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,621 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,621 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:25,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:25,621 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,621 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,622 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:06:25,622 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:25,622 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,622 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:06:25,622 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,622 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:06:25,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:25,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:25,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:25,624 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33229,1690214755329' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-24 16:06:25,624 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10cadbec[Count = 1] remaining members to acquire global barrier 2023-07-24 16:06:25,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:25,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:25,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:25,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:25,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:25,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:25,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33053,1690214755222' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-24 16:06:25,627 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@10cadbec[Count = 0] remaining members to acquire global barrier 2023-07-24 16:06:25,627 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 16:06:25,627 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,628 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,628 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,628 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,628 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 16:06:25,628 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 16:06:25,628 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,629 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 16:06:25,629 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 16:06:25,629 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 16:06:25,629 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504. 2023-07-24 16:06:25,629 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 16:06:25,629 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504. started... 2023-07-24 16:06:25,629 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0. 2023-07-24 16:06:25,629 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 16:06:25,629 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0. started... 2023-07-24 16:06:25,629 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 43fdafeb0b3edd45e786f5bf598bc504: 2023-07-24 16:06:25,629 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,630 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 16:06:25,630 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7096bd1527743e9b459aa76d9879eed0: 2023-07-24 16:06:25,629 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 16:06:25,630 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,630 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38047,1690214755282' in zk 2023-07-24 16:06:25,630 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,631 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 16:06:25,631 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 16:06:25,631 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 16:06:25,631 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 16:06:25,633 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 16:06:25,633 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:06:25,633 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 16:06:25,649 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504. completed. 2023-07-24 16:06:25,649 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504. 2023-07-24 16:06:25,649 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 16:06:25,649 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 16:06:25,649 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,649 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 16:06:25,649 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33229,1690214755329' in zk 2023-07-24 16:06:25,649 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0. completed. 2023-07-24 16:06:25,649 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0. 2023-07-24 16:06:25,650 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 16:06:25,650 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 16:06:25,650 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,650 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 16:06:25,650 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33053,1690214755222' in zk 2023-07-24 16:06:25,651 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 16:06:25,651 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,651 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:06:25,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,651 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 16:06:25,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:25,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:25,653 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,653 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 16:06:25,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:25,654 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:06:25,654 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 16:06:25,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:25,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:25,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:25,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:25,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33229,1690214755329': 2023-07-24 16:06:25,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33229,1690214755329' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 16:06:25,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:25,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:25,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:25,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:25,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:25,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:25,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:25,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33053,1690214755222': 2023-07-24 16:06:25,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33053,1690214755222' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 16:06:25,664 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-24 16:06:25,664 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 16:06:25,664 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 16:06:25,664 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,664 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 16:06:25,666 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,666 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,666 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,666 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:25,666 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:25,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:25,666 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:25,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,666 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:25,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:25,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:25,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:25,667 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:25,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:25,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:25,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:25,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,668 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:25,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:25,669 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:25,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,671 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:25,671 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:25,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,672 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:25,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,676 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,676 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:25,676 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:25,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:25,676 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:06:25,676 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:25,676 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,676 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:25,678 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-24 16:06:25,678 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,676 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:25,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,678 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:25,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 16:06:25,676 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:25,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:25,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:25,678 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:25,678 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:25,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:25,678 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:25,678 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:25,679 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:25,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:25,679 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:25,679 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 16:06:25,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:25,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:25,679 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,679 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,683 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:06:25,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 16:06:25,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 16:06:25,685 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 16:06:25,691 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,692 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,739 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,808 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-24 16:06:25,808 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,809 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:25,809 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690214785582Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1690214785691 (+109 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1690214785691Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1690214785691Writing data manifest for emptySnaptb0-testExportFileSystemState at 1690214785696 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1690214785723 (+27 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690214785808 (+85 ms) 2023-07-24 16:06:25,812 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 16:06:25,815 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 229 msec 2023-07-24 16:06:25,885 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:06:25,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 16:06:25,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 16:06:25,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33229] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 16:06:25,892 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33053] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 16:06:25,896 DEBUG [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-24 16:06:25,897 DEBUG [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504. 2023-07-24 16:06:25,897 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 16:06:25,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 16:06:25,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690214785909 (current time:1690214785909). 2023-07-24 16:06:25,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 16:06:25,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(139): Connect 0x055c2ce7 to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:06:25,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@214df83c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:06:25,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:06:25,920 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50220, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:06:25,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x055c2ce7 to 127.0.0.1:49766 2023-07-24 16:06:25,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:06:25,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(139): Connect 0x04cae504 to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:06:25,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e575258, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:06:25,936 DEBUG [hconnection-0x2ed50bc5-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:06:25,937 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50226, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:06:25,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x04cae504 to 127.0.0.1:49766 2023-07-24 16:06:25,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:06:25,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 16:06:25,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 16:06:25,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 16:06:25,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 16:06:25,947 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 16:06:25,948 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690215385948 2023-07-24 16:06:25,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 16:06:25,948 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-24 16:06:25,951 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 16:06:25,952 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 16:06:25,952 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 16:06:25,952 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 16:06:25,953 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-24 16:06:25,954 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 16:06:25,955 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690215385955 2023-07-24 16:06:25,967 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-24 16:06:25,967 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-24 16:06:25,967 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:06:25,968 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-24 16:06:25,968 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-24 16:06:25,969 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,969 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,970 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,970 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:25,970 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:25,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:25,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:25,970 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:25,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:25,971 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:25,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:25,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:25,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,971 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,971 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,971 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,972 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,972 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 16:06:25,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 16:06:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 16:06:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 16:06:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,972 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 16:06:25,972 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 16:06:25,972 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 16:06:25,972 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 16:06:25,972 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 16:06:25,973 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 16:06:25,973 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 16:06:25,973 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 16:06:25,973 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 16:06:25,973 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:06:25,973 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:06:25,974 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 16:06:25,975 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 16:06:25,975 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 16:06:25,975 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 16:06:25,973 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:06:25,975 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33229,1690214755329' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 16:06:25,976 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 16:06:25,977 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 16:06:25,977 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38047,1690214755282' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 16:06:25,975 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33053,1690214755222' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 16:06:25,978 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,978 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:25,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:25,979 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,979 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,979 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:25,979 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,979 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:06:25,979 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,980 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:06:25,980 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,980 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:06:25,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:25,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 16:06:25,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:25,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:25,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33229,1690214755329' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-24 16:06:25,981 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a21011f[Count = 1] remaining members to acquire global barrier 2023-07-24 16:06:25,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:25,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:25,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:25,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:25,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 16:06:25,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:25,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:25,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33053,1690214755222' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-24 16:06:25,983 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a21011f[Count = 0] remaining members to acquire global barrier 2023-07-24 16:06:25,983 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 16:06:25,983 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,985 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,985 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,986 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 16:06:25,986 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:25,985 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,986 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 16:06:25,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,986 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 16:06:25,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 16:06:25,986 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38047,1690214755282' in zk 2023-07-24 16:06:25,986 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 16:06:25,986 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 16:06:25,986 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0. 2023-07-24 16:06:25,986 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:25,986 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0. started... 2023-07-24 16:06:25,986 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 16:06:25,986 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 16:06:25,986 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 16:06:25,986 INFO [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7096bd1527743e9b459aa76d9879eed0 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-24 16:06:25,987 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504. 2023-07-24 16:06:25,986 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 16:06:25,987 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504. started... 2023-07-24 16:06:25,987 INFO [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 43fdafeb0b3edd45e786f5bf598bc504 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-24 16:06:25,988 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 16:06:25,988 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:06:25,988 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 16:06:26,020 INFO [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307241e4dc142bc1e4c92935dde5a9b341faa to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307241e4dc142bc1e4c92935dde5a9b341faa 2023-07-24 16:06:26,022 INFO [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230724f56bcecea3044fe6a991d13b0c8b24a1 to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230724f56bcecea3044fe6a991d13b0c8b24a1 2023-07-24 16:06:26,036 INFO [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemState/43fdafeb0b3edd45e786f5bf598bc504/.tmp/cf/5b74c791de3d45fa962e2b1f1b32207f 2023-07-24 16:06:26,041 INFO [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemState/7096bd1527743e9b459aa76d9879eed0/.tmp/cf/af4a2f6919ab4390802e495c664e9dd5 2023-07-24 16:06:26,043 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemState/43fdafeb0b3edd45e786f5bf598bc504/.tmp/cf/5b74c791de3d45fa962e2b1f1b32207f as hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemState/43fdafeb0b3edd45e786f5bf598bc504/cf/5b74c791de3d45fa962e2b1f1b32207f 2023-07-24 16:06:26,048 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemState/7096bd1527743e9b459aa76d9879eed0/.tmp/cf/af4a2f6919ab4390802e495c664e9dd5 as hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemState/7096bd1527743e9b459aa76d9879eed0/cf/af4a2f6919ab4390802e495c664e9dd5 2023-07-24 16:06:26,050 INFO [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemState/43fdafeb0b3edd45e786f5bf598bc504/cf/5b74c791de3d45fa962e2b1f1b32207f, entries=3, sequenceid=6, filesize=5.4 K 2023-07-24 16:06:26,051 INFO [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 43fdafeb0b3edd45e786f5bf598bc504 in 64ms, sequenceid=6, compaction requested=false 2023-07-24 16:06:26,051 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-24 16:06:26,051 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 43fdafeb0b3edd45e786f5bf598bc504: 2023-07-24 16:06:26,051 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 16:06:26,052 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 16:06:26,052 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemState/43fdafeb0b3edd45e786f5bf598bc504/cf/5b74c791de3d45fa962e2b1f1b32207f] hfiles 2023-07-24 16:06:26,052 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemState/43fdafeb0b3edd45e786f5bf598bc504/cf/5b74c791de3d45fa962e2b1f1b32207f for snapshot=snaptb0-testExportFileSystemState 2023-07-24 16:06:26,052 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:06:26,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 16:06:26,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 16:06:26,054 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 16:06:26,055 INFO [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemState/7096bd1527743e9b459aa76d9879eed0/cf/af4a2f6919ab4390802e495c664e9dd5, entries=47, sequenceid=6, filesize=12.8 K 2023-07-24 16:06:26,056 INFO [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 7096bd1527743e9b459aa76d9879eed0 in 70ms, sequenceid=6, compaction requested=false 2023-07-24 16:06:26,061 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7096bd1527743e9b459aa76d9879eed0: 2023-07-24 16:06:26,061 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 16:06:26,061 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 16:06:26,061 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemState/7096bd1527743e9b459aa76d9879eed0/cf/af4a2f6919ab4390802e495c664e9dd5] hfiles 2023-07-24 16:06:26,061 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemState/7096bd1527743e9b459aa76d9879eed0/cf/af4a2f6919ab4390802e495c664e9dd5 for snapshot=snaptb0-testExportFileSystemState 2023-07-24 16:06:26,083 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0. completed. 2023-07-24 16:06:26,083 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0. 2023-07-24 16:06:26,083 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 16:06:26,083 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 16:06:26,083 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:26,083 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 16:06:26,083 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33053,1690214755222' in zk 2023-07-24 16:06:26,088 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:26,088 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 16:06:26,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:26,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:26,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:26,088 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:06:26,088 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 16:06:26,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:26,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:26,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 16:06:26,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:26,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:26,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:26,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:26,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 16:06:26,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:26,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:26,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33053,1690214755222': 2023-07-24 16:06:26,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33053,1690214755222' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 16:06:26,254 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:06:26,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 16:06:26,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 16:06:26,255 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 16:06:26,471 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504. completed. 2023-07-24 16:06:26,471 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504. 2023-07-24 16:06:26,472 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 16:06:26,472 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 16:06:26,472 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:26,472 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 16:06:26,472 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33229,1690214755329' in zk 2023-07-24 16:06:26,474 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 16:06:26,474 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:26,474 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:06:26,474 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 16:06:26,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:26,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:26,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:26,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:26,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:26,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 16:06:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:26,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:26,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:26,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 16:06:26,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:26,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:26,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:26,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,33229,1690214755329': 2023-07-24 16:06:26,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33229,1690214755329' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 16:06:26,481 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-24 16:06:26,481 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 16:06:26,481 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 16:06:26,481 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-24 16:06:26,481 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 16:06:26,483 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 16:06:26,483 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 16:06:26,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 16:06:26,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 16:06:26,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:26,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:26,483 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:26,484 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 16:06:26,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 16:06:26,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 16:06:26,484 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 16:06:26,484 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:26,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 16:06:26,484 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:26,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 16:06:26,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:26,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 16:06:26,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:26,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:26,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:26,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:26,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:26,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:26,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 16:06:26,485 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:26,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 16:06:26,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 16:06:26,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 16:06:26,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:26,487 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:26,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 16:06:26,487 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:26,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:26,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:26,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:26,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:26,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 16:06:26,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:26,490 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:26,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:26,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:26,490 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:26,491 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:26,494 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:26,494 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:26,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:26,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:26,495 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-24 16:06:26,495 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:06:26,494 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 16:06:26,494 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:26,496 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:26,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:26,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:26,495 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-24 16:06:26,497 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:26,497 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:26,497 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:26,497 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:26,498 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 16:06:26,498 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:26,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:26,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:26,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 16:06:26,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:26,498 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 16:06:26,498 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:26,498 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 16:06:26,498 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:26,498 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:26,498 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 16:06:26,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:26,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:26,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:26,498 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 16:06:26,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:26,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:26,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307241e4dc142bc1e4c92935dde5a9b341faa, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230724f56bcecea3044fe6a991d13b0c8b24a1] mob files 2023-07-24 16:06:26,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307241e4dc142bc1e4c92935dde5a9b341faa 2023-07-24 16:06:26,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230724f56bcecea3044fe6a991d13b0c8b24a1 2023-07-24 16:06:26,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-24 16:06:26,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 16:06:26,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 16:06:26,555 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:06:26,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 16:06:26,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 16:06:26,557 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 16:06:26,566 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-24 16:06:26,566 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 16:06:26,566 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 16:06:26,566 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690214785948Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1690214786512 (+564 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1690214786512Loading Region manifests for snaptb0-testExportFileSystemState at 1690214786512Writing data manifest for snaptb0-testExportFileSystemState at 1690214786517 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1690214786531 (+14 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690214786566 (+35 ms) 2023-07-24 16:06:26,569 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 16:06:26,572 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 619 msec 2023-07-24 16:06:27,057 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:06:27,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 16:06:27,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 16:06:27,060 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214787060 2023-07-24 16:06:27,060 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:32943, tgtDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214787060, rawTgtDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214787060, srcFsUri=hdfs://localhost:32943, srcDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0 2023-07-24 16:06:27,090 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:32943, inputRoot=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0 2023-07-24 16:06:27,090 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-184221967_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214787060, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214787060/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 16:06:27,090 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:32943, inputRoot=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0, snapshotDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-24 16:06:27,112 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214787060/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 16:06:27,161 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:27,161 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:27,162 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:27,162 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:28,132 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/hadoop-8613404294958488604.jar 2023-07-24 16:06:28,132 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:28,132 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:28,206 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/hadoop-7479600602555784188.jar 2023-07-24 16:06:28,206 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:28,207 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:28,207 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:28,208 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:28,208 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:28,209 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:28,210 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 16:06:28,210 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 16:06:28,211 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 16:06:28,212 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 16:06:28,212 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 16:06:28,213 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 16:06:28,213 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 16:06:28,213 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 16:06:28,214 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 16:06:28,214 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 16:06:28,215 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:06:28,215 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:06:28,216 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 16:06:28,217 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:06:28,217 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:06:28,218 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 16:06:28,219 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 16:06:28,653 WARN [Listener at jenkins-hbase4.apache.org/42941] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 16:06:28,656 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-24 16:06:28,659 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-24 16:06:29,386 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 16:06:29,386 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 16:06:29,394 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0001_000001 (auth:SIMPLE) 2023-07-24 16:06:29,728 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0002_000001 (auth:SIMPLE) 2023-07-24 16:06:30,125 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 16:06:34,588 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0002_000001 (auth:SIMPLE) 2023-07-24 16:06:36,845 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0002_000001 (auth:SIMPLE) 2023-07-24 16:06:39,793 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0002_000001 (auth:SIMPLE) 2023-07-24 16:06:40,876 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 16:06:40,879 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 16:06:40,889 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-24 16:06:40,889 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 16:06:40,890 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 16:06:40,890 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-526159531_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 16:06:40,890 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-24 16:06:40,890 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-24 16:06:40,890 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-526159531_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214787060/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214787060/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 16:06:40,891 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214787060/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-24 16:06:40,891 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214787060/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-24 16:06:40,898 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-24 16:06:40,899 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-24 16:06:40,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-24 16:06:40,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 16:06:40,904 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214800904"}]},"ts":"1690214800904"} 2023-07-24 16:06:40,905 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-24 16:06:40,907 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-24 16:06:40,908 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=43fdafeb0b3edd45e786f5bf598bc504, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7096bd1527743e9b459aa76d9879eed0, UNASSIGN}] 2023-07-24 16:06:40,910 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7096bd1527743e9b459aa76d9879eed0, UNASSIGN 2023-07-24 16:06:40,910 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=43fdafeb0b3edd45e786f5bf598bc504, UNASSIGN 2023-07-24 16:06:40,911 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=7096bd1527743e9b459aa76d9879eed0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:40,911 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=43fdafeb0b3edd45e786f5bf598bc504, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:40,911 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690214800911"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214800911"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214800911"}]},"ts":"1690214800911"} 2023-07-24 16:06:40,912 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690214800911"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214800911"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214800911"}]},"ts":"1690214800911"} 2023-07-24 16:06:40,913 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 7096bd1527743e9b459aa76d9879eed0, server=jenkins-hbase4.apache.org,33053,1690214755222}] 2023-07-24 16:06:40,914 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 43fdafeb0b3edd45e786f5bf598bc504, server=jenkins-hbase4.apache.org,33229,1690214755329}] 2023-07-24 16:06:41,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 16:06:41,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7096bd1527743e9b459aa76d9879eed0 2023-07-24 16:06:41,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7096bd1527743e9b459aa76d9879eed0, disabling compactions & flushes 2023-07-24 16:06:41,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0. 2023-07-24 16:06:41,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0. 2023-07-24 16:06:41,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0. after waiting 0 ms 2023-07-24 16:06:41,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0. 2023-07-24 16:06:41,073 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 43fdafeb0b3edd45e786f5bf598bc504 2023-07-24 16:06:41,073 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 43fdafeb0b3edd45e786f5bf598bc504, disabling compactions & flushes 2023-07-24 16:06:41,073 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504. 2023-07-24 16:06:41,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504. 2023-07-24 16:06:41,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504. after waiting 0 ms 2023-07-24 16:06:41,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504. 2023-07-24 16:06:41,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemState/7096bd1527743e9b459aa76d9879eed0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 16:06:41,090 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemState/43fdafeb0b3edd45e786f5bf598bc504/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 16:06:41,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:06:41,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:06:41,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0. 2023-07-24 16:06:41,092 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504. 2023-07-24 16:06:41,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 43fdafeb0b3edd45e786f5bf598bc504: 2023-07-24 16:06:41,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7096bd1527743e9b459aa76d9879eed0: 2023-07-24 16:06:41,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 43fdafeb0b3edd45e786f5bf598bc504 2023-07-24 16:06:41,095 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=43fdafeb0b3edd45e786f5bf598bc504, regionState=CLOSED 2023-07-24 16:06:41,095 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690214801095"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214801095"}]},"ts":"1690214801095"} 2023-07-24 16:06:41,095 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7096bd1527743e9b459aa76d9879eed0 2023-07-24 16:06:41,096 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=7096bd1527743e9b459aa76d9879eed0, regionState=CLOSED 2023-07-24 16:06:41,096 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690214801096"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214801096"}]},"ts":"1690214801096"} 2023-07-24 16:06:41,101 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-24 16:06:41,102 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 43fdafeb0b3edd45e786f5bf598bc504, server=jenkins-hbase4.apache.org,33229,1690214755329 in 183 msec 2023-07-24 16:06:41,102 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-24 16:06:41,102 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 7096bd1527743e9b459aa76d9879eed0, server=jenkins-hbase4.apache.org,33053,1690214755222 in 185 msec 2023-07-24 16:06:41,103 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=43fdafeb0b3edd45e786f5bf598bc504, UNASSIGN in 193 msec 2023-07-24 16:06:41,105 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-24 16:06:41,105 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7096bd1527743e9b459aa76d9879eed0, UNASSIGN in 194 msec 2023-07-24 16:06:41,106 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214801106"}]},"ts":"1690214801106"} 2023-07-24 16:06:41,108 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-24 16:06:41,109 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-24 16:06:41,112 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 211 msec 2023-07-24 16:06:41,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 16:06:41,206 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-24 16:06:41,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-24 16:06:41,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 16:06:41,211 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 16:06:41,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-24 16:06:41,212 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 16:06:41,214 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33229] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-24 16:06:41,219 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 16:06:41,219 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 16:06:41,219 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 16:06:41,219 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemState/7096bd1527743e9b459aa76d9879eed0 2023-07-24 16:06:41,219 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemState/43fdafeb0b3edd45e786f5bf598bc504 2023-07-24 16:06:41,219 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 16:06:41,219 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 16:06:41,219 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 16:06:41,221 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 16:06:41,221 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:06:41,221 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-24 16:06:41,221 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 16:06:41,221 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:06:41,221 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 16:06:41,221 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:06:41,221 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:06:41,222 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-24 16:06:41,223 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemState/43fdafeb0b3edd45e786f5bf598bc504/cf, FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemState/43fdafeb0b3edd45e786f5bf598bc504/recovered.edits] 2023-07-24 16:06:41,223 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-24 16:06:41,223 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 16:06:41,223 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemState/7096bd1527743e9b459aa76d9879eed0/cf, FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemState/7096bd1527743e9b459aa76d9879eed0/recovered.edits] 2023-07-24 16:06:41,228 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemState/7096bd1527743e9b459aa76d9879eed0/cf/af4a2f6919ab4390802e495c664e9dd5 to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportFileSystemState/7096bd1527743e9b459aa76d9879eed0/cf/af4a2f6919ab4390802e495c664e9dd5 2023-07-24 16:06:41,230 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemState/43fdafeb0b3edd45e786f5bf598bc504/cf/5b74c791de3d45fa962e2b1f1b32207f to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportFileSystemState/43fdafeb0b3edd45e786f5bf598bc504/cf/5b74c791de3d45fa962e2b1f1b32207f 2023-07-24 16:06:41,238 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemState/7096bd1527743e9b459aa76d9879eed0/recovered.edits/9.seqid to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportFileSystemState/7096bd1527743e9b459aa76d9879eed0/recovered.edits/9.seqid 2023-07-24 16:06:41,239 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemState/7096bd1527743e9b459aa76d9879eed0 2023-07-24 16:06:41,239 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemState/43fdafeb0b3edd45e786f5bf598bc504/recovered.edits/9.seqid to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportFileSystemState/43fdafeb0b3edd45e786f5bf598bc504/recovered.edits/9.seqid 2023-07-24 16:06:41,240 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemState/43fdafeb0b3edd45e786f5bf598bc504 2023-07-24 16:06:41,240 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-24 16:06:41,240 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-24 16:06:41,241 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-24 16:06:41,245 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307241e4dc142bc1e4c92935dde5a9b341faa to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307241e4dc142bc1e4c92935dde5a9b341faa 2023-07-24 16:06:41,247 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230724f56bcecea3044fe6a991d13b0c8b24a1 to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230724f56bcecea3044fe6a991d13b0c8b24a1 2023-07-24 16:06:41,247 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-24 16:06:41,250 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 16:06:41,253 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-24 16:06:41,257 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-24 16:06:41,258 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 16:06:41,258 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-24 16:06:41,258 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690214801258"}]},"ts":"9223372036854775807"} 2023-07-24 16:06:41,258 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690214801258"}]},"ts":"9223372036854775807"} 2023-07-24 16:06:41,261 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 16:06:41,261 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 43fdafeb0b3edd45e786f5bf598bc504, NAME => 'testtb-testExportFileSystemState,,1690214784905.43fdafeb0b3edd45e786f5bf598bc504.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 7096bd1527743e9b459aa76d9879eed0, NAME => 'testtb-testExportFileSystemState,1,1690214784905.7096bd1527743e9b459aa76d9879eed0.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 16:06:41,261 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-24 16:06:41,261 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690214801261"}]},"ts":"9223372036854775807"} 2023-07-24 16:06:41,263 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-24 16:06:41,265 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 16:06:41,267 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 58 msec 2023-07-24 16:06:41,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-24 16:06:41,324 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-24 16:06:41,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-24 16:06:41,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-24 16:06:41,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-24 16:06:41,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-24 16:06:41,377 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=765 (was 751) Potentially hanging thread: Thread-2027 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1124596271_1 at /127.0.0.1:44340 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:42941 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-526159531_17 at /127.0.0.1:44682 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-526159531_17 at /127.0.0.1:36042 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x26dbae7d-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x26dbae7d-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-526159531_17 at /127.0.0.1:32970 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1124596271_1 at /127.0.0.1:54324 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:37033 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x26dbae7d-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x26dbae7d-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=919 (was 919), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=462 (was 364) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 179) - ProcessCount LEAK? -, AvailableMemoryMB=5818 (was 6144) 2023-07-24 16:06:41,377 WARN [Listener at jenkins-hbase4.apache.org/42941] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-24 16:06:41,406 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=765, OpenFileDescriptor=919, MaxFileDescriptor=60000, SystemLoadAverage=462, ProcessCount=181, AvailableMemoryMB=5817 2023-07-24 16:06:41,406 WARN [Listener at jenkins-hbase4.apache.org/42941] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-24 16:06:41,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 16:06:41,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-24 16:06:41,415 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 16:06:41,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-24 16:06:41,416 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 16:06:41,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 16:06:41,419 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testConsecutiveExports/d0f17f477d1b3b45bc39d5fc08cd22c7 2023-07-24 16:06:41,419 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testConsecutiveExports/0216d23bbd534474dfd74152079e326f 2023-07-24 16:06:41,419 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testConsecutiveExports/d0f17f477d1b3b45bc39d5fc08cd22c7 empty. 2023-07-24 16:06:41,419 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testConsecutiveExports/0216d23bbd534474dfd74152079e326f empty. 2023-07-24 16:06:41,420 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testConsecutiveExports/d0f17f477d1b3b45bc39d5fc08cd22c7 2023-07-24 16:06:41,420 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testConsecutiveExports/0216d23bbd534474dfd74152079e326f 2023-07-24 16:06:41,420 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-24 16:06:41,445 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-24 16:06:41,446 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => d0f17f477d1b3b45bc39d5fc08cd22c7, NAME => 'testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp 2023-07-24 16:06:41,447 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0216d23bbd534474dfd74152079e326f, NAME => 'testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp 2023-07-24 16:06:41,477 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:06:41,477 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 0216d23bbd534474dfd74152079e326f, disabling compactions & flushes 2023-07-24 16:06:41,477 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f. 2023-07-24 16:06:41,477 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f. 2023-07-24 16:06:41,477 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f. after waiting 0 ms 2023-07-24 16:06:41,477 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f. 2023-07-24 16:06:41,477 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f. 2023-07-24 16:06:41,477 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 0216d23bbd534474dfd74152079e326f: 2023-07-24 16:06:41,478 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:06:41,478 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing d0f17f477d1b3b45bc39d5fc08cd22c7, disabling compactions & flushes 2023-07-24 16:06:41,478 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7. 2023-07-24 16:06:41,478 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7. 2023-07-24 16:06:41,478 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7. after waiting 0 ms 2023-07-24 16:06:41,478 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7. 2023-07-24 16:06:41,478 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7. 2023-07-24 16:06:41,478 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for d0f17f477d1b3b45bc39d5fc08cd22c7: 2023-07-24 16:06:41,481 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 16:06:41,482 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690214801482"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214801482"}]},"ts":"1690214801482"} 2023-07-24 16:06:41,482 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690214801482"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214801482"}]},"ts":"1690214801482"} 2023-07-24 16:06:41,485 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 16:06:41,486 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 16:06:41,486 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214801486"}]},"ts":"1690214801486"} 2023-07-24 16:06:41,488 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-24 16:06:41,493 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 16:06:41,495 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 16:06:41,495 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 16:06:41,495 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 16:06:41,495 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 16:06:41,496 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d0f17f477d1b3b45bc39d5fc08cd22c7, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0216d23bbd534474dfd74152079e326f, ASSIGN}] 2023-07-24 16:06:41,503 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0216d23bbd534474dfd74152079e326f, ASSIGN 2023-07-24 16:06:41,503 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d0f17f477d1b3b45bc39d5fc08cd22c7, ASSIGN 2023-07-24 16:06:41,504 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0216d23bbd534474dfd74152079e326f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33229,1690214755329; forceNewPlan=false, retain=false 2023-07-24 16:06:41,505 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d0f17f477d1b3b45bc39d5fc08cd22c7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38047,1690214755282; forceNewPlan=false, retain=false 2023-07-24 16:06:41,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 16:06:41,654 INFO [jenkins-hbase4:43489] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 16:06:41,658 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=0216d23bbd534474dfd74152079e326f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:41,658 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=d0f17f477d1b3b45bc39d5fc08cd22c7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:41,658 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690214801658"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214801658"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214801658"}]},"ts":"1690214801658"} 2023-07-24 16:06:41,659 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690214801658"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214801658"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214801658"}]},"ts":"1690214801658"} 2023-07-24 16:06:41,661 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure 0216d23bbd534474dfd74152079e326f, server=jenkins-hbase4.apache.org,33229,1690214755329}] 2023-07-24 16:06:41,663 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure d0f17f477d1b3b45bc39d5fc08cd22c7, server=jenkins-hbase4.apache.org,38047,1690214755282}] 2023-07-24 16:06:41,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 16:06:41,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f. 2023-07-24 16:06:41,819 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0216d23bbd534474dfd74152079e326f, NAME => 'testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 16:06:41,820 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f. service=AccessControlService 2023-07-24 16:06:41,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 16:06:41,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 0216d23bbd534474dfd74152079e326f 2023-07-24 16:06:41,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:06:41,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0216d23bbd534474dfd74152079e326f 2023-07-24 16:06:41,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0216d23bbd534474dfd74152079e326f 2023-07-24 16:06:41,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7. 2023-07-24 16:06:41,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d0f17f477d1b3b45bc39d5fc08cd22c7, NAME => 'testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 16:06:41,823 INFO [StoreOpener-0216d23bbd534474dfd74152079e326f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0216d23bbd534474dfd74152079e326f 2023-07-24 16:06:41,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7. service=AccessControlService 2023-07-24 16:06:41,823 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 16:06:41,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports d0f17f477d1b3b45bc39d5fc08cd22c7 2023-07-24 16:06:41,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:06:41,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d0f17f477d1b3b45bc39d5fc08cd22c7 2023-07-24 16:06:41,823 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d0f17f477d1b3b45bc39d5fc08cd22c7 2023-07-24 16:06:41,824 DEBUG [StoreOpener-0216d23bbd534474dfd74152079e326f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testConsecutiveExports/0216d23bbd534474dfd74152079e326f/cf 2023-07-24 16:06:41,824 DEBUG [StoreOpener-0216d23bbd534474dfd74152079e326f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testConsecutiveExports/0216d23bbd534474dfd74152079e326f/cf 2023-07-24 16:06:41,825 INFO [StoreOpener-d0f17f477d1b3b45bc39d5fc08cd22c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d0f17f477d1b3b45bc39d5fc08cd22c7 2023-07-24 16:06:41,825 INFO [StoreOpener-0216d23bbd534474dfd74152079e326f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0216d23bbd534474dfd74152079e326f columnFamilyName cf 2023-07-24 16:06:41,826 DEBUG [StoreOpener-d0f17f477d1b3b45bc39d5fc08cd22c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testConsecutiveExports/d0f17f477d1b3b45bc39d5fc08cd22c7/cf 2023-07-24 16:06:41,826 DEBUG [StoreOpener-d0f17f477d1b3b45bc39d5fc08cd22c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testConsecutiveExports/d0f17f477d1b3b45bc39d5fc08cd22c7/cf 2023-07-24 16:06:41,826 INFO [StoreOpener-d0f17f477d1b3b45bc39d5fc08cd22c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d0f17f477d1b3b45bc39d5fc08cd22c7 columnFamilyName cf 2023-07-24 16:06:41,827 INFO [StoreOpener-0216d23bbd534474dfd74152079e326f-1] regionserver.HStore(310): Store=0216d23bbd534474dfd74152079e326f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 16:06:41,827 INFO [StoreOpener-d0f17f477d1b3b45bc39d5fc08cd22c7-1] regionserver.HStore(310): Store=d0f17f477d1b3b45bc39d5fc08cd22c7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 16:06:41,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testConsecutiveExports/0216d23bbd534474dfd74152079e326f 2023-07-24 16:06:41,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testConsecutiveExports/0216d23bbd534474dfd74152079e326f 2023-07-24 16:06:41,828 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testConsecutiveExports/d0f17f477d1b3b45bc39d5fc08cd22c7 2023-07-24 16:06:41,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testConsecutiveExports/d0f17f477d1b3b45bc39d5fc08cd22c7 2023-07-24 16:06:41,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0216d23bbd534474dfd74152079e326f 2023-07-24 16:06:41,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d0f17f477d1b3b45bc39d5fc08cd22c7 2023-07-24 16:06:41,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testConsecutiveExports/0216d23bbd534474dfd74152079e326f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 16:06:41,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0216d23bbd534474dfd74152079e326f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72960069, jitterRate=0.08718974888324738}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 16:06:41,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0216d23bbd534474dfd74152079e326f: 2023-07-24 16:06:41,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testConsecutiveExports/d0f17f477d1b3b45bc39d5fc08cd22c7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 16:06:41,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f., pid=45, masterSystemTime=1690214801815 2023-07-24 16:06:41,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d0f17f477d1b3b45bc39d5fc08cd22c7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63783906, jitterRate=-0.049545735120773315}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 16:06:41,835 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d0f17f477d1b3b45bc39d5fc08cd22c7: 2023-07-24 16:06:41,835 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7., pid=46, masterSystemTime=1690214801817 2023-07-24 16:06:41,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f. 2023-07-24 16:06:41,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f. 2023-07-24 16:06:41,842 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=0216d23bbd534474dfd74152079e326f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:41,842 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690214801842"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690214801842"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690214801842"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690214801842"}]},"ts":"1690214801842"} 2023-07-24 16:06:41,842 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7. 2023-07-24 16:06:41,843 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7. 2023-07-24 16:06:41,843 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=d0f17f477d1b3b45bc39d5fc08cd22c7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:41,843 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690214801843"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690214801843"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690214801843"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690214801843"}]},"ts":"1690214801843"} 2023-07-24 16:06:41,848 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-24 16:06:41,848 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure 0216d23bbd534474dfd74152079e326f, server=jenkins-hbase4.apache.org,33229,1690214755329 in 185 msec 2023-07-24 16:06:41,849 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-24 16:06:41,849 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure d0f17f477d1b3b45bc39d5fc08cd22c7, server=jenkins-hbase4.apache.org,38047,1690214755282 in 184 msec 2023-07-24 16:06:41,850 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0216d23bbd534474dfd74152079e326f, ASSIGN in 352 msec 2023-07-24 16:06:41,851 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-24 16:06:41,851 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d0f17f477d1b3b45bc39d5fc08cd22c7, ASSIGN in 353 msec 2023-07-24 16:06:41,851 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 16:06:41,852 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214801852"}]},"ts":"1690214801852"} 2023-07-24 16:06:41,853 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-24 16:06:41,855 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 16:06:41,855 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-24 16:06:41,857 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33229] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 16:06:41,859 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:06:41,859 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:06:41,859 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:06:41,859 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:06:41,860 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 16:06:41,860 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 16:06:41,860 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 16:06:41,860 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 16:06:41,861 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 452 msec 2023-07-24 16:06:42,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 16:06:42,020 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-24 16:06:42,023 DEBUG [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-24 16:06:42,023 DEBUG [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7. 2023-07-24 16:06:42,025 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 16:06:42,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 16:06:42,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690214802037 (current time:1690214802037). 2023-07-24 16:06:42,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 16:06:42,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(139): Connect 0x5deb55ee to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:06:42,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@727547e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:06:42,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:06:42,052 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36766, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:06:42,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5deb55ee to 127.0.0.1:49766 2023-07-24 16:06:42,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:06:42,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(139): Connect 0x1778f68b to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:06:42,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10bb85af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:06:42,062 DEBUG [hconnection-0x4829ca57-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:06:42,068 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:06:42,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1778f68b to 127.0.0.1:49766 2023-07-24 16:06:42,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:06:42,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 16:06:42,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 16:06:42,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 16:06:42,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 16:06:42,079 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 16:06:42,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 16:06:42,080 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-24 16:06:42,080 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690215402080 2023-07-24 16:06:42,081 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 16:06:42,081 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 16:06:42,087 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 16:06:42,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 16:06:42,088 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 10 msec 2023-07-24 16:06:42,089 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 16:06:42,090 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690215402090 2023-07-24 16:06:42,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,113 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-24 16:06:42,113 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:06:42,115 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-24 16:06:42,115 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-24 16:06:42,181 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,181 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:06:42,181 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 16:06:42,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 16:06:42,183 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 16:06:42,184 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:42,184 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,184 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:42,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:42,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:42,184 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:42,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:42,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:42,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:42,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:42,185 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,185 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,185 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,185 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 16:06:42,185 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,185 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,185 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 16:06:42,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 16:06:42,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 16:06:42,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,186 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 16:06:42,186 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 16:06:42,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,186 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,186 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,186 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 16:06:42,186 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 16:06:42,186 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:06:42,186 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 16:06:42,186 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:06:42,188 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 16:06:42,188 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,189 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 16:06:42,189 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 16:06:42,189 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:06:42,188 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 16:06:42,192 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 16:06:42,192 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 16:06:42,192 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38047,1690214755282' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 16:06:42,189 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 16:06:42,192 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33229,1690214755329' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 16:06:42,192 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33053,1690214755222' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 16:06:42,194 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,194 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,194 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,194 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,194 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:42,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:42,194 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,194 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:06:42,194 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,194 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:06:42,194 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,195 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:06:42,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:42,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:42,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:42,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:42,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38047,1690214755282' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-24 16:06:42,197 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f5b9a81[Count = 1] remaining members to acquire global barrier 2023-07-24 16:06:42,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:42,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:42,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:42,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:42,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:42,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:42,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33229,1690214755329' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-24 16:06:42,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f5b9a81[Count = 0] remaining members to acquire global barrier 2023-07-24 16:06:42,199 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-24 16:06:42,199 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,200 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,201 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,200 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,201 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 16:06:42,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,201 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,201 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7. 2023-07-24 16:06:42,201 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 16:06:42,201 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 16:06:42,201 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 16:06:42,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,201 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 16:06:42,201 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 16:06:42,201 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,201 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 16:06:42,201 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7. started... 2023-07-24 16:06:42,201 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 16:06:42,201 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 16:06:42,201 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f. 2023-07-24 16:06:42,202 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33053,1690214755222' in zk 2023-07-24 16:06:42,202 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f. started... 2023-07-24 16:06:42,202 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d0f17f477d1b3b45bc39d5fc08cd22c7: 2023-07-24 16:06:42,203 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0216d23bbd534474dfd74152079e326f: 2023-07-24 16:06:42,203 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,203 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,203 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 16:06:42,204 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 16:06:42,204 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 16:06:42,204 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 16:06:42,209 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 16:06:42,210 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:06:42,210 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 16:06:42,215 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7. completed. 2023-07-24 16:06:42,215 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7. 2023-07-24 16:06:42,215 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 16:06:42,215 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 16:06:42,215 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,215 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 16:06:42,215 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38047,1690214755282' in zk 2023-07-24 16:06:42,217 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,217 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 16:06:42,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:42,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:42,217 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:06:42,217 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 16:06:42,218 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f. completed. 2023-07-24 16:06:42,218 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f. 2023-07-24 16:06:42,218 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 16:06:42,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:42,219 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 16:06:42,219 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,219 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 16:06:42,219 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33229,1690214755329' in zk 2023-07-24 16:06:42,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:42,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,221 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,221 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 16:06:42,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,221 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:06:42,221 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 16:06:42,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:42,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:42,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:42,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,38047,1690214755282': 2023-07-24 16:06:42,225 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38047,1690214755282' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-24 16:06:42,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:42,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:42,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:42,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:42,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:42,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:42,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33229,1690214755329': 2023-07-24 16:06:42,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33229,1690214755329' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-24 16:06:42,229 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-24 16:06:42,229 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 16:06:42,229 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 16:06:42,229 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,229 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 16:06:42,231 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,231 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:42,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:42,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,231 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:42,231 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,232 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:42,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:42,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:42,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:42,232 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:42,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:42,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,233 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,233 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:42,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:42,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,234 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,234 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:42,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:42,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:42,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:42,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:42,237 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,238 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:42,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,238 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:42,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,243 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:42,243 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:42,243 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:42,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:42,243 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,243 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:42,243 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:06:42,243 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:42,243 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,243 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,245 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-24 16:06:42,243 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:42,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:42,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:42,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:42,245 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,245 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,245 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 16:06:42,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:42,245 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:42,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:42,245 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,246 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,246 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,246 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:42,246 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:42,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:42,246 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 16:06:42,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:42,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:42,246 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,247 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:42,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:42,255 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,296 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-24 16:06:42,296 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,296 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 16:06:42,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690214802081Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1690214802255 (+174 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1690214802255Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1690214802255Writing data manifest for emptySnaptb0-testConsecutiveExports at 1690214802262 (+7 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1690214802271 (+9 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690214802296 (+25 ms) 2023-07-24 16:06:42,299 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 16:06:42,301 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 213 msec 2023-07-24 16:06:42,383 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:06:42,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 16:06:42,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 16:06:42,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38047] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 16:06:42,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33229] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 16:06:42,392 DEBUG [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-24 16:06:42,392 DEBUG [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7. 2023-07-24 16:06:42,392 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 16:06:42,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 16:06:42,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690214802403 (current time:1690214802403). 2023-07-24 16:06:42,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 16:06:42,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(139): Connect 0x016ee690 to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:06:42,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@504ffd2a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:06:42,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:06:42,422 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36786, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:06:42,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x016ee690 to 127.0.0.1:49766 2023-07-24 16:06:42,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:06:42,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(139): Connect 0x3e7068be to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:06:42,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48dc4386, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:06:42,431 DEBUG [hconnection-0x67d5411a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:06:42,434 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36798, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:06:42,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3e7068be to 127.0.0.1:49766 2023-07-24 16:06:42,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:06:42,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 16:06:42,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 16:06:42,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 16:06:42,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 16:06:42,443 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 16:06:42,443 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690215402443 2023-07-24 16:06:42,444 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-24 16:06:42,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 16:06:42,445 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 16:06:42,445 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 16:06:42,446 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 16:06:42,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 16:06:42,447 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-24 16:06:42,448 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 16:06:42,449 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690215402449 2023-07-24 16:06:42,458 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-24 16:06:42,459 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-24 16:06:42,459 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:06:42,460 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-24 16:06:42,460 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-24 16:06:42,460 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,460 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,462 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:42,462 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:42,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:42,462 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:42,462 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:42,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:42,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:42,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:42,463 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,463 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:42,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,463 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,463 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 16:06:42,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,463 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,464 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 16:06:42,464 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 16:06:42,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,464 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 16:06:42,464 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 16:06:42,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 16:06:42,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,465 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 16:06:42,465 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 16:06:42,465 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 16:06:42,465 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:06:42,465 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 16:06:42,465 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 16:06:42,471 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 16:06:42,471 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 16:06:42,471 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:06:42,471 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 16:06:42,472 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 16:06:42,472 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 16:06:42,471 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:06:42,473 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33053,1690214755222' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 16:06:42,472 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 16:06:42,474 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 16:06:42,474 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 16:06:42,474 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38047,1690214755282' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 16:06:42,474 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33229,1690214755329' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 16:06:42,476 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,477 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,477 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,477 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,477 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:06:42,477 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,477 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,477 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,477 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,477 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:06:42,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:42,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:42,477 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:06:42,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:42,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:42,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 16:06:42,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:42,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:42,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38047,1690214755282' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-24 16:06:42,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4194e40f[Count = 1] remaining members to acquire global barrier 2023-07-24 16:06:42,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:42,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:42,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:42,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:42,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 16:06:42,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:42,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:42,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33229,1690214755329' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-24 16:06:42,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4194e40f[Count = 0] remaining members to acquire global barrier 2023-07-24 16:06:42,481 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-24 16:06:42,481 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,484 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,484 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,484 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,485 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 16:06:42,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,485 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 16:06:42,485 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,485 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7. 2023-07-24 16:06:42,485 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 16:06:42,485 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7. started... 2023-07-24 16:06:42,485 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 16:06:42,485 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 16:06:42,485 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 16:06:42,485 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33053,1690214755222' in zk 2023-07-24 16:06:42,485 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,485 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 16:06:42,485 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 16:06:42,485 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f. 2023-07-24 16:06:42,485 INFO [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d0f17f477d1b3b45bc39d5fc08cd22c7 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-24 16:06:42,485 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f. started... 2023-07-24 16:06:42,485 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 16:06:42,486 INFO [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0216d23bbd534474dfd74152079e326f 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-24 16:06:42,487 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 16:06:42,487 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:06:42,487 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 16:06:42,522 INFO [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307248881f13d6c274e51abd2a0693eb5c398 to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307248881f13d6c274e51abd2a0693eb5c398 2023-07-24 16:06:42,524 INFO [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230724aeb6b62e08be4e3fb4cdd22534bb6f49 to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230724aeb6b62e08be4e3fb4cdd22534bb6f49 2023-07-24 16:06:42,539 INFO [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testConsecutiveExports/d0f17f477d1b3b45bc39d5fc08cd22c7/.tmp/cf/c217fb93059549bab2b53bd7e7ccfc3f 2023-07-24 16:06:42,544 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testConsecutiveExports/d0f17f477d1b3b45bc39d5fc08cd22c7/.tmp/cf/c217fb93059549bab2b53bd7e7ccfc3f as hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testConsecutiveExports/d0f17f477d1b3b45bc39d5fc08cd22c7/cf/c217fb93059549bab2b53bd7e7ccfc3f 2023-07-24 16:06:42,545 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:06:42,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 16:06:42,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 16:06:42,547 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 16:06:42,549 INFO [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testConsecutiveExports/d0f17f477d1b3b45bc39d5fc08cd22c7/cf/c217fb93059549bab2b53bd7e7ccfc3f, entries=2, sequenceid=6, filesize=5.2 K 2023-07-24 16:06:42,550 INFO [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for d0f17f477d1b3b45bc39d5fc08cd22c7 in 65ms, sequenceid=6, compaction requested=false 2023-07-24 16:06:42,551 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-24 16:06:42,551 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d0f17f477d1b3b45bc39d5fc08cd22c7: 2023-07-24 16:06:42,551 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 16:06:42,552 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 16:06:42,552 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testConsecutiveExports/d0f17f477d1b3b45bc39d5fc08cd22c7/cf/c217fb93059549bab2b53bd7e7ccfc3f] hfiles 2023-07-24 16:06:42,552 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testConsecutiveExports/d0f17f477d1b3b45bc39d5fc08cd22c7/cf/c217fb93059549bab2b53bd7e7ccfc3f for snapshot=snaptb0-testConsecutiveExports 2023-07-24 16:06:42,562 INFO [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testConsecutiveExports/0216d23bbd534474dfd74152079e326f/.tmp/cf/10e09b00fffe47b2b80c4e70c88555f0 2023-07-24 16:06:42,568 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testConsecutiveExports/0216d23bbd534474dfd74152079e326f/.tmp/cf/10e09b00fffe47b2b80c4e70c88555f0 as hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testConsecutiveExports/0216d23bbd534474dfd74152079e326f/cf/10e09b00fffe47b2b80c4e70c88555f0 2023-07-24 16:06:42,576 INFO [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testConsecutiveExports/0216d23bbd534474dfd74152079e326f/cf/10e09b00fffe47b2b80c4e70c88555f0, entries=48, sequenceid=6, filesize=12.9 K 2023-07-24 16:06:42,578 INFO [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 0216d23bbd534474dfd74152079e326f in 92ms, sequenceid=6, compaction requested=false 2023-07-24 16:06:42,579 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0216d23bbd534474dfd74152079e326f: 2023-07-24 16:06:42,580 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 16:06:42,580 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 16:06:42,580 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testConsecutiveExports/0216d23bbd534474dfd74152079e326f/cf/10e09b00fffe47b2b80c4e70c88555f0] hfiles 2023-07-24 16:06:42,580 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testConsecutiveExports/0216d23bbd534474dfd74152079e326f/cf/10e09b00fffe47b2b80c4e70c88555f0 for snapshot=snaptb0-testConsecutiveExports 2023-07-24 16:06:42,580 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7. completed. 2023-07-24 16:06:42,580 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7. 2023-07-24 16:06:42,580 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 16:06:42,580 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 16:06:42,580 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,580 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 16:06:42,580 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,38047,1690214755282' in zk 2023-07-24 16:06:42,583 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,583 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 16:06:42,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:42,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:42,583 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:06:42,583 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 16:06:42,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:42,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:42,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 16:06:42,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:42,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:42,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 16:06:42,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:42,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,38047,1690214755282': 2023-07-24 16:06:42,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38047,1690214755282' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-24 16:06:42,590 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f. completed. 2023-07-24 16:06:42,590 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f. 2023-07-24 16:06:42,590 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 16:06:42,590 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 16:06:42,590 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,590 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 16:06:42,590 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33229,1690214755329' in zk 2023-07-24 16:06:42,593 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 16:06:42,593 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,593 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:06:42,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:42,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:42,593 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 16:06:42,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:42,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:42,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 16:06:42,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:42,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:42,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 16:06:42,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:42,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33229,1690214755329': 2023-07-24 16:06:42,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33229,1690214755329' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-24 16:06:42,598 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-24 16:06:42,598 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 16:06:42,598 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 16:06:42,598 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-24 16:06:42,598 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 16:06:42,602 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,602 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:06:42,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:06:42,602 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,602 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:42,602 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,602 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:42,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:42,603 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:06:42,602 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:42,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:42,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:42,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:42,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:42,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:42,603 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:42,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 16:06:42,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,604 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:06:42,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 16:06:42,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:42,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,605 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:06:42,606 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:42,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 16:06:42,606 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:42,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,612 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,612 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:42,613 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:42,613 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:06:42,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:42,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:42,612 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:42,613 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-24 16:06:42,613 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:06:42,613 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:42,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:42,613 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:42,613 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:06:42,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:06:42,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:06:42,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:42,613 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-24 16:06:42,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:42,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:42,615 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 16:06:42,613 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:42,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:06:42,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:42,615 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,615 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 16:06:42,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:06:42,615 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,616 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:06:42,616 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,616 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:06:42,616 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:06:42,616 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,616 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230724aeb6b62e08be4e3fb4cdd22534bb6f49, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307248881f13d6c274e51abd2a0693eb5c398] mob files 2023-07-24 16:06:42,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230724aeb6b62e08be4e3fb4cdd22534bb6f49 2023-07-24 16:06:42,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307248881f13d6c274e51abd2a0693eb5c398 2023-07-24 16:06:42,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-24 16:06:42,629 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,678 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-24 16:06:42,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,678 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690214802444Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1690214802629 (+185 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1690214802629Loading Region manifests for snaptb0-testConsecutiveExports at 1690214802629Writing data manifest for snaptb0-testConsecutiveExports at 1690214802635 (+6 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1690214802647 (+12 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690214802678 (+31 ms) 2023-07-24 16:06:42,685 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 16:06:42,687 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 241 msec 2023-07-24 16:06:42,747 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:06:42,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 16:06:42,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 16:06:42,749 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/local-export-1690214802749 2023-07-24 16:06:42,749 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/local-export-1690214802749, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/local-export-1690214802749, srcFsUri=hdfs://localhost:32943, srcDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0 2023-07-24 16:06:42,782 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:32943, inputRoot=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0 2023-07-24 16:06:42,782 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@37239d36, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/local-export-1690214802749, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/local-export-1690214802749/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,782 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:32943, inputRoot=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0, snapshotDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-24 16:06:42,792 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/local-export-1690214802749/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 16:06:42,814 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:42,815 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:42,815 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:42,816 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:43,780 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/hadoop-3092575420663108733.jar 2023-07-24 16:06:43,781 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:43,781 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:43,849 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/hadoop-1932402538878017528.jar 2023-07-24 16:06:43,849 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:43,850 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:43,850 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:43,851 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:43,851 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:43,851 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:43,852 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 16:06:43,852 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 16:06:43,852 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 16:06:43,853 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 16:06:43,853 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 16:06:43,854 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 16:06:43,854 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 16:06:43,854 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 16:06:43,854 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 16:06:43,855 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 16:06:43,856 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:06:43,856 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:06:43,857 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 16:06:43,857 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:06:43,857 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:06:43,858 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 16:06:43,858 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 16:06:44,243 WARN [Listener at jenkins-hbase4.apache.org/42941] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 16:06:44,245 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-24 16:06:44,247 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-24 16:06:45,974 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 16:06:45,974 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 16:06:45,977 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0002_000001 (auth:SIMPLE) 2023-07-24 16:06:46,400 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0003_000001 (auth:SIMPLE) 2023-07-24 16:06:46,682 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 16:06:51,027 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0003_000001 (auth:SIMPLE) 2023-07-24 16:06:53,318 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0003_000001 (auth:SIMPLE) 2023-07-24 16:06:56,107 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0003_000001 (auth:SIMPLE) 2023-07-24 16:06:57,420 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 16:06:57,420 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 16:06:57,424 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-24 16:06:57,424 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 16:06:57,425 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 16:06:57,425 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-526159531_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 16:06:57,427 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 16:06:57,427 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 16:06:57,427 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@6c79a990 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/local-export-1690214802749/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/local-export-1690214802749/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 16:06:57,428 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/local-export-1690214802749/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 16:06:57,428 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/local-export-1690214802749/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 16:06:57,429 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/local-export-1690214802749, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/local-export-1690214802749, srcFsUri=hdfs://localhost:32943, srcDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0 2023-07-24 16:06:57,452 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:32943, inputRoot=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0 2023-07-24 16:06:57,452 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@243feeba, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/local-export-1690214802749, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/local-export-1690214802749/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 16:06:57,452 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:32943, inputRoot=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0, snapshotDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-24 16:06:57,462 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/local-export-1690214802749/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 16:06:57,476 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:57,477 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:57,477 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:57,477 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:58,432 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/hadoop-614783793394376492.jar 2023-07-24 16:06:58,432 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:58,432 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:58,499 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/hadoop-3048640756678386141.jar 2023-07-24 16:06:58,499 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:58,500 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:58,500 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:58,501 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:58,501 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:58,501 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 16:06:58,502 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 16:06:58,502 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 16:06:58,502 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 16:06:58,503 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 16:06:58,503 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 16:06:58,504 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 16:06:58,504 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 16:06:58,504 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 16:06:58,505 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 16:06:58,505 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 16:06:58,506 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:06:58,506 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:06:58,507 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 16:06:58,507 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:06:58,507 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:06:58,508 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 16:06:58,508 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 16:06:58,911 WARN [Listener at jenkins-hbase4.apache.org/42941] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 16:06:58,913 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-24 16:06:58,915 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-24 16:07:02,287 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 16:07:02,287 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 16:07:02,290 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0003_000001 (auth:SIMPLE) 2023-07-24 16:07:02,997 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0004_000001 (auth:SIMPLE) 2023-07-24 16:07:07,404 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0004_000001 (auth:SIMPLE) 2023-07-24 16:07:09,660 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0004_000001 (auth:SIMPLE) 2023-07-24 16:07:14,120 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 16:07:14,120 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 16:07:14,124 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-24 16:07:14,124 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 16:07:14,124 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 16:07:14,124 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-526159531_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 16:07:14,131 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 16:07:14,131 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 16:07:14,131 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@6c79a990 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/local-export-1690214802749/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/local-export-1690214802749/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 16:07:14,132 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/local-export-1690214802749/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 16:07:14,132 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/local-export-1690214802749/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 16:07:14,145 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-24 16:07:14,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-24 16:07:14,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-24 16:07:14,150 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214834150"}]},"ts":"1690214834150"} 2023-07-24 16:07:14,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 16:07:14,152 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-24 16:07:14,154 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-24 16:07:14,154 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d0f17f477d1b3b45bc39d5fc08cd22c7, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0216d23bbd534474dfd74152079e326f, UNASSIGN}] 2023-07-24 16:07:14,156 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d0f17f477d1b3b45bc39d5fc08cd22c7, UNASSIGN 2023-07-24 16:07:14,156 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0216d23bbd534474dfd74152079e326f, UNASSIGN 2023-07-24 16:07:14,157 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=d0f17f477d1b3b45bc39d5fc08cd22c7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:14,157 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=0216d23bbd534474dfd74152079e326f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:14,158 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690214834157"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214834157"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214834157"}]},"ts":"1690214834157"} 2023-07-24 16:07:14,158 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690214834157"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214834157"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214834157"}]},"ts":"1690214834157"} 2023-07-24 16:07:14,159 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure d0f17f477d1b3b45bc39d5fc08cd22c7, server=jenkins-hbase4.apache.org,38047,1690214755282}] 2023-07-24 16:07:14,160 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure 0216d23bbd534474dfd74152079e326f, server=jenkins-hbase4.apache.org,33229,1690214755329}] 2023-07-24 16:07:14,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 16:07:14,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0216d23bbd534474dfd74152079e326f 2023-07-24 16:07:14,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d0f17f477d1b3b45bc39d5fc08cd22c7 2023-07-24 16:07:14,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0216d23bbd534474dfd74152079e326f, disabling compactions & flushes 2023-07-24 16:07:14,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d0f17f477d1b3b45bc39d5fc08cd22c7, disabling compactions & flushes 2023-07-24 16:07:14,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f. 2023-07-24 16:07:14,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7. 2023-07-24 16:07:14,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f. 2023-07-24 16:07:14,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7. 2023-07-24 16:07:14,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f. after waiting 0 ms 2023-07-24 16:07:14,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7. after waiting 0 ms 2023-07-24 16:07:14,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f. 2023-07-24 16:07:14,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7. 2023-07-24 16:07:14,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testConsecutiveExports/0216d23bbd534474dfd74152079e326f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 16:07:14,332 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testConsecutiveExports/d0f17f477d1b3b45bc39d5fc08cd22c7/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 16:07:14,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:07:14,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:07:14,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7. 2023-07-24 16:07:14,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d0f17f477d1b3b45bc39d5fc08cd22c7: 2023-07-24 16:07:14,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f. 2023-07-24 16:07:14,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0216d23bbd534474dfd74152079e326f: 2023-07-24 16:07:14,337 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d0f17f477d1b3b45bc39d5fc08cd22c7 2023-07-24 16:07:14,338 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=d0f17f477d1b3b45bc39d5fc08cd22c7, regionState=CLOSED 2023-07-24 16:07:14,338 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0216d23bbd534474dfd74152079e326f 2023-07-24 16:07:14,338 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690214834338"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214834338"}]},"ts":"1690214834338"} 2023-07-24 16:07:14,339 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=0216d23bbd534474dfd74152079e326f, regionState=CLOSED 2023-07-24 16:07:14,339 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690214834339"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214834339"}]},"ts":"1690214834339"} 2023-07-24 16:07:14,359 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-24 16:07:14,359 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure d0f17f477d1b3b45bc39d5fc08cd22c7, server=jenkins-hbase4.apache.org,38047,1690214755282 in 193 msec 2023-07-24 16:07:14,359 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-24 16:07:14,359 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure 0216d23bbd534474dfd74152079e326f, server=jenkins-hbase4.apache.org,33229,1690214755329 in 194 msec 2023-07-24 16:07:14,361 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=d0f17f477d1b3b45bc39d5fc08cd22c7, UNASSIGN in 205 msec 2023-07-24 16:07:14,362 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-24 16:07:14,363 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0216d23bbd534474dfd74152079e326f, UNASSIGN in 205 msec 2023-07-24 16:07:14,364 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214834364"}]},"ts":"1690214834364"} 2023-07-24 16:07:14,366 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-24 16:07:14,368 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-24 16:07:14,370 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 224 msec 2023-07-24 16:07:14,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 16:07:14,455 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-24 16:07:14,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-24 16:07:14,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 16:07:14,460 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 16:07:14,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-24 16:07:14,462 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 16:07:14,467 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33229] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-24 16:07:14,470 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 16:07:14,470 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 16:07:14,470 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 16:07:14,470 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 16:07:14,471 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 16:07:14,471 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 16:07:14,471 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 16:07:14,472 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 16:07:14,473 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 16:07:14,473 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:14,473 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 16:07:14,473 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 16:07:14,473 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:14,473 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:14,474 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 16:07:14,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-24 16:07:14,474 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:14,490 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testConsecutiveExports/d0f17f477d1b3b45bc39d5fc08cd22c7 2023-07-24 16:07:14,492 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testConsecutiveExports/0216d23bbd534474dfd74152079e326f 2023-07-24 16:07:14,494 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testConsecutiveExports/d0f17f477d1b3b45bc39d5fc08cd22c7/cf, FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testConsecutiveExports/d0f17f477d1b3b45bc39d5fc08cd22c7/recovered.edits] 2023-07-24 16:07:14,494 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testConsecutiveExports/0216d23bbd534474dfd74152079e326f/cf, FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testConsecutiveExports/0216d23bbd534474dfd74152079e326f/recovered.edits] 2023-07-24 16:07:14,501 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testConsecutiveExports/d0f17f477d1b3b45bc39d5fc08cd22c7/cf/c217fb93059549bab2b53bd7e7ccfc3f to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testConsecutiveExports/d0f17f477d1b3b45bc39d5fc08cd22c7/cf/c217fb93059549bab2b53bd7e7ccfc3f 2023-07-24 16:07:14,502 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testConsecutiveExports/0216d23bbd534474dfd74152079e326f/cf/10e09b00fffe47b2b80c4e70c88555f0 to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testConsecutiveExports/0216d23bbd534474dfd74152079e326f/cf/10e09b00fffe47b2b80c4e70c88555f0 2023-07-24 16:07:14,507 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testConsecutiveExports/d0f17f477d1b3b45bc39d5fc08cd22c7/recovered.edits/9.seqid to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testConsecutiveExports/d0f17f477d1b3b45bc39d5fc08cd22c7/recovered.edits/9.seqid 2023-07-24 16:07:14,508 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testConsecutiveExports/0216d23bbd534474dfd74152079e326f/recovered.edits/9.seqid to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testConsecutiveExports/0216d23bbd534474dfd74152079e326f/recovered.edits/9.seqid 2023-07-24 16:07:14,509 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testConsecutiveExports/d0f17f477d1b3b45bc39d5fc08cd22c7 2023-07-24 16:07:14,509 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testConsecutiveExports/0216d23bbd534474dfd74152079e326f 2023-07-24 16:07:14,509 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-24 16:07:14,509 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-24 16:07:14,511 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-24 16:07:14,516 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230724aeb6b62e08be4e3fb4cdd22534bb6f49 to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230724aeb6b62e08be4e3fb4cdd22534bb6f49 2023-07-24 16:07:14,517 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307248881f13d6c274e51abd2a0693eb5c398 to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307248881f13d6c274e51abd2a0693eb5c398 2023-07-24 16:07:14,518 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-24 16:07:14,521 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 16:07:14,525 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-24 16:07:14,538 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-24 16:07:14,540 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 16:07:14,541 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-24 16:07:14,541 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690214834541"}]},"ts":"9223372036854775807"} 2023-07-24 16:07:14,541 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690214834541"}]},"ts":"9223372036854775807"} 2023-07-24 16:07:14,546 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 16:07:14,546 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d0f17f477d1b3b45bc39d5fc08cd22c7, NAME => 'testtb-testConsecutiveExports,,1690214801408.d0f17f477d1b3b45bc39d5fc08cd22c7.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0216d23bbd534474dfd74152079e326f, NAME => 'testtb-testConsecutiveExports,1,1690214801408.0216d23bbd534474dfd74152079e326f.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 16:07:14,546 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-24 16:07:14,546 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690214834546"}]},"ts":"9223372036854775807"} 2023-07-24 16:07:14,563 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-24 16:07:14,568 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 16:07:14,571 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 112 msec 2023-07-24 16:07:14,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-24 16:07:14,576 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-24 16:07:14,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-24 16:07:14,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-24 16:07:14,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-24 16:07:14,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-24 16:07:14,629 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=746 (was 765), OpenFileDescriptor=893 (was 919), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=459 (was 462), ProcessCount=184 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=6170 (was 5817) - AvailableMemoryMB LEAK? - 2023-07-24 16:07:14,629 WARN [Listener at jenkins-hbase4.apache.org/42941] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-24 16:07:14,652 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=746, OpenFileDescriptor=893, MaxFileDescriptor=60000, SystemLoadAverage=459, ProcessCount=184, AvailableMemoryMB=6168 2023-07-24 16:07:14,652 WARN [Listener at jenkins-hbase4.apache.org/42941] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-24 16:07:14,653 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 16:07:14,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:14,658 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 16:07:14,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-24 16:07:14,659 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 16:07:14,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 16:07:14,662 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2716c94bbe510883ffbf1d5f775097f1 2023-07-24 16:07:14,662 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/db873e25934e7aeaaf59bd533066d312 2023-07-24 16:07:14,662 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2716c94bbe510883ffbf1d5f775097f1 empty. 2023-07-24 16:07:14,662 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/db873e25934e7aeaaf59bd533066d312 empty. 2023-07-24 16:07:14,663 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2716c94bbe510883ffbf1d5f775097f1 2023-07-24 16:07:14,663 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/db873e25934e7aeaaf59bd533066d312 2023-07-24 16:07:14,663 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-24 16:07:14,706 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-24 16:07:14,708 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2716c94bbe510883ffbf1d5f775097f1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp 2023-07-24 16:07:14,708 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => db873e25934e7aeaaf59bd533066d312, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp 2023-07-24 16:07:14,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 16:07:14,784 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:07:14,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing db873e25934e7aeaaf59bd533066d312, disabling compactions & flushes 2023-07-24 16:07:14,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:07:14,785 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312. 2023-07-24 16:07:14,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 2716c94bbe510883ffbf1d5f775097f1, disabling compactions & flushes 2023-07-24 16:07:14,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312. 2023-07-24 16:07:14,785 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1. 2023-07-24 16:07:14,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312. after waiting 0 ms 2023-07-24 16:07:14,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1. 2023-07-24 16:07:14,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312. 2023-07-24 16:07:14,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1. after waiting 0 ms 2023-07-24 16:07:14,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1. 2023-07-24 16:07:14,785 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312. 2023-07-24 16:07:14,785 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1. 2023-07-24 16:07:14,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 2716c94bbe510883ffbf1d5f775097f1: 2023-07-24 16:07:14,785 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for db873e25934e7aeaaf59bd533066d312: 2023-07-24 16:07:14,799 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 16:07:14,800 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690214834800"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214834800"}]},"ts":"1690214834800"} 2023-07-24 16:07:14,800 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690214834800"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214834800"}]},"ts":"1690214834800"} 2023-07-24 16:07:14,815 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 16:07:14,816 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 16:07:14,816 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214834816"}]},"ts":"1690214834816"} 2023-07-24 16:07:14,818 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-24 16:07:14,823 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 16:07:14,825 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 16:07:14,825 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 16:07:14,825 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 16:07:14,825 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 16:07:14,825 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2716c94bbe510883ffbf1d5f775097f1, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=db873e25934e7aeaaf59bd533066d312, ASSIGN}] 2023-07-24 16:07:14,828 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=db873e25934e7aeaaf59bd533066d312, ASSIGN 2023-07-24 16:07:14,829 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2716c94bbe510883ffbf1d5f775097f1, ASSIGN 2023-07-24 16:07:14,830 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=db873e25934e7aeaaf59bd533066d312, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38047,1690214755282; forceNewPlan=false, retain=false 2023-07-24 16:07:14,830 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2716c94bbe510883ffbf1d5f775097f1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33229,1690214755329; forceNewPlan=false, retain=false 2023-07-24 16:07:14,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 16:07:14,980 INFO [jenkins-hbase4:43489] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 16:07:14,986 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=2716c94bbe510883ffbf1d5f775097f1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:14,986 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=db873e25934e7aeaaf59bd533066d312, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:14,986 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690214834986"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214834986"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214834986"}]},"ts":"1690214834986"} 2023-07-24 16:07:14,986 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690214834986"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214834986"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214834986"}]},"ts":"1690214834986"} 2023-07-24 16:07:14,991 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 2716c94bbe510883ffbf1d5f775097f1, server=jenkins-hbase4.apache.org,33229,1690214755329}] 2023-07-24 16:07:14,992 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure db873e25934e7aeaaf59bd533066d312, server=jenkins-hbase4.apache.org,38047,1690214755282}] 2023-07-24 16:07:15,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1. 2023-07-24 16:07:15,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2716c94bbe510883ffbf1d5f775097f1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 16:07:15,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1. service=AccessControlService 2023-07-24 16:07:15,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 16:07:15,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 2716c94bbe510883ffbf1d5f775097f1 2023-07-24 16:07:15,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:07:15,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2716c94bbe510883ffbf1d5f775097f1 2023-07-24 16:07:15,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2716c94bbe510883ffbf1d5f775097f1 2023-07-24 16:07:15,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312. 2023-07-24 16:07:15,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => db873e25934e7aeaaf59bd533066d312, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 16:07:15,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312. service=AccessControlService 2023-07-24 16:07:15,151 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 16:07:15,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion db873e25934e7aeaaf59bd533066d312 2023-07-24 16:07:15,151 INFO [StoreOpener-2716c94bbe510883ffbf1d5f775097f1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2716c94bbe510883ffbf1d5f775097f1 2023-07-24 16:07:15,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:07:15,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for db873e25934e7aeaaf59bd533066d312 2023-07-24 16:07:15,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for db873e25934e7aeaaf59bd533066d312 2023-07-24 16:07:15,153 DEBUG [StoreOpener-2716c94bbe510883ffbf1d5f775097f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion/2716c94bbe510883ffbf1d5f775097f1/cf 2023-07-24 16:07:15,153 DEBUG [StoreOpener-2716c94bbe510883ffbf1d5f775097f1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion/2716c94bbe510883ffbf1d5f775097f1/cf 2023-07-24 16:07:15,154 INFO [StoreOpener-db873e25934e7aeaaf59bd533066d312-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region db873e25934e7aeaaf59bd533066d312 2023-07-24 16:07:15,157 INFO [StoreOpener-2716c94bbe510883ffbf1d5f775097f1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2716c94bbe510883ffbf1d5f775097f1 columnFamilyName cf 2023-07-24 16:07:15,159 DEBUG [StoreOpener-db873e25934e7aeaaf59bd533066d312-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion/db873e25934e7aeaaf59bd533066d312/cf 2023-07-24 16:07:15,159 DEBUG [StoreOpener-db873e25934e7aeaaf59bd533066d312-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion/db873e25934e7aeaaf59bd533066d312/cf 2023-07-24 16:07:15,160 INFO [StoreOpener-db873e25934e7aeaaf59bd533066d312-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region db873e25934e7aeaaf59bd533066d312 columnFamilyName cf 2023-07-24 16:07:15,162 INFO [StoreOpener-db873e25934e7aeaaf59bd533066d312-1] regionserver.HStore(310): Store=db873e25934e7aeaaf59bd533066d312/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 16:07:15,162 INFO [StoreOpener-2716c94bbe510883ffbf1d5f775097f1-1] regionserver.HStore(310): Store=2716c94bbe510883ffbf1d5f775097f1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 16:07:15,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion/db873e25934e7aeaaf59bd533066d312 2023-07-24 16:07:15,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion/2716c94bbe510883ffbf1d5f775097f1 2023-07-24 16:07:15,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion/2716c94bbe510883ffbf1d5f775097f1 2023-07-24 16:07:15,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion/db873e25934e7aeaaf59bd533066d312 2023-07-24 16:07:15,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for db873e25934e7aeaaf59bd533066d312 2023-07-24 16:07:15,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2716c94bbe510883ffbf1d5f775097f1 2023-07-24 16:07:15,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion/db873e25934e7aeaaf59bd533066d312/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 16:07:15,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened db873e25934e7aeaaf59bd533066d312; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67451722, jitterRate=0.00510898232460022}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 16:07:15,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for db873e25934e7aeaaf59bd533066d312: 2023-07-24 16:07:15,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312., pid=61, masterSystemTime=1690214835145 2023-07-24 16:07:15,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion/2716c94bbe510883ffbf1d5f775097f1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 16:07:15,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2716c94bbe510883ffbf1d5f775097f1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67565514, jitterRate=0.006804615259170532}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 16:07:15,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2716c94bbe510883ffbf1d5f775097f1: 2023-07-24 16:07:15,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312. 2023-07-24 16:07:15,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312. 2023-07-24 16:07:15,191 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=db873e25934e7aeaaf59bd533066d312, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:15,191 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690214835191"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690214835191"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690214835191"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690214835191"}]},"ts":"1690214835191"} 2023-07-24 16:07:15,195 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-24 16:07:15,195 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure db873e25934e7aeaaf59bd533066d312, server=jenkins-hbase4.apache.org,38047,1690214755282 in 201 msec 2023-07-24 16:07:15,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1., pid=60, masterSystemTime=1690214835143 2023-07-24 16:07:15,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1. 2023-07-24 16:07:15,201 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1. 2023-07-24 16:07:15,202 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=db873e25934e7aeaaf59bd533066d312, ASSIGN in 370 msec 2023-07-24 16:07:15,202 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=2716c94bbe510883ffbf1d5f775097f1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:15,202 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690214835202"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690214835202"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690214835202"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690214835202"}]},"ts":"1690214835202"} 2023-07-24 16:07:15,206 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-24 16:07:15,206 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 2716c94bbe510883ffbf1d5f775097f1, server=jenkins-hbase4.apache.org,33229,1690214755329 in 213 msec 2023-07-24 16:07:15,208 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-24 16:07:15,209 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2716c94bbe510883ffbf1d5f775097f1, ASSIGN in 381 msec 2023-07-24 16:07:15,209 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 16:07:15,210 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214835209"}]},"ts":"1690214835209"} 2023-07-24 16:07:15,211 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-24 16:07:15,215 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 16:07:15,215 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-24 16:07:15,217 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33229] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 16:07:15,219 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:15,219 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:15,219 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:15,219 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:15,223 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 16:07:15,223 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,224 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 16:07:15,224 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 16:07:15,224 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 16:07:15,227 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 571 msec 2023-07-24 16:07:15,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 16:07:15,264 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-24 16:07:15,269 DEBUG [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,269 DEBUG [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1. 2023-07-24 16:07:15,271 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 16:07:15,327 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 16:07:15,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690214835327 (current time:1690214835327). 2023-07-24 16:07:15,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 16:07:15,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(139): Connect 0x648cd613 to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:07:15,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4ec69848, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:07:15,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:07:15,345 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39568, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:07:15,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x648cd613 to 127.0.0.1:49766 2023-07-24 16:07:15,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:07:15,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(139): Connect 0x05feb16e to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:07:15,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c0d38c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:07:15,370 DEBUG [hconnection-0x7dbe1fe4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:07:15,372 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39574, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:07:15,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x05feb16e to 127.0.0.1:49766 2023-07-24 16:07:15,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:07:15,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 16:07:15,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 16:07:15,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 16:07:15,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 16:07:15,383 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 16:07:15,386 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690215435386 2023-07-24 16:07:15,386 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 16:07:15,388 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 16:07:15,388 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 16:07:15,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 16:07:15,389 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 16:07:15,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 8 msec 2023-07-24 16:07:15,393 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 16:07:15,394 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690215435394 2023-07-24 16:07:15,430 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,431 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-24 16:07:15,431 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:15,433 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-24 16:07:15,433 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-24 16:07:15,437 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,437 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,439 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:15,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:15,440 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:15,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:15,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:15,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:15,440 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:15,440 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:15,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:15,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:15,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,441 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:15,441 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:15,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,441 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,441 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:15,441 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 16:07:15,441 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,442 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 16:07:15,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,442 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 16:07:15,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 16:07:15,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 16:07:15,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,443 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 16:07:15,443 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 16:07:15,450 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,482 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,465 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,482 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 16:07:15,482 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 16:07:15,483 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:15,482 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 16:07:15,485 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 16:07:15,485 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 16:07:15,482 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:15,485 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33053,1690214755222' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 16:07:15,487 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 16:07:15,487 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 16:07:15,487 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33229,1690214755329' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 16:07:15,485 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:15,490 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,490 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,490 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:07:15,495 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:07:15,495 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 16:07:15,495 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 16:07:15,495 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38047,1690214755282' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 16:07:15,500 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:15,500 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:15,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:15,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:15,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 16:07:15,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 16:07:15,500 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 16:07:15,500 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,501 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:07:15,502 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:15,502 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:15,503 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,503 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:07:15,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:15,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:15,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:15,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:15,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:15,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33229,1690214755329' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 16:07:15,505 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@747526a[Count = 1] remaining members to acquire global barrier 2023-07-24 16:07:15,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:15,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:15,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:15,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:15,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:15,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:15,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:15,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:15,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:15,508 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38047,1690214755282' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 16:07:15,508 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@747526a[Count = 0] remaining members to acquire global barrier 2023-07-24 16:07:15,508 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-24 16:07:15,508 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,509 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,509 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,509 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 16:07:15,510 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 16:07:15,510 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33053,1690214755222' in zk 2023-07-24 16:07:15,509 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,510 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:15,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,510 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 16:07:15,510 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 16:07:15,510 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:15,511 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 16:07:15,515 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 16:07:15,515 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 16:07:15,516 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312. 2023-07-24 16:07:15,516 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312. started... 2023-07-24 16:07:15,516 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 16:07:15,516 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 16:07:15,516 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1. 2023-07-24 16:07:15,518 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1. started... 2023-07-24 16:07:15,518 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for db873e25934e7aeaaf59bd533066d312: 2023-07-24 16:07:15,518 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2716c94bbe510883ffbf1d5f775097f1: 2023-07-24 16:07:15,519 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,519 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 16:07:15,519 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,519 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 16:07:15,519 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 16:07:15,519 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 16:07:15,519 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:15,519 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 16:07:15,519 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 16:07:15,559 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1. completed. 2023-07-24 16:07:15,559 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1. 2023-07-24 16:07:15,560 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 16:07:15,560 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 16:07:15,560 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:15,560 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 16:07:15,560 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33229,1690214755329' in zk 2023-07-24 16:07:15,562 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 16:07:15,562 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:15,562 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:15,562 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 16:07:15,563 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312. completed. 2023-07-24 16:07:15,563 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312. 2023-07-24 16:07:15,564 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 16:07:15,564 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 16:07:15,564 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:15,564 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 16:07:15,564 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38047,1690214755282' in zk 2023-07-24 16:07:15,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:15,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:15,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:15,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:15,570 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:15,570 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 16:07:15,570 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:15,570 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 16:07:15,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:15,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:15,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:15,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:15,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:15,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:15,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:15,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:15,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33229,1690214755329': 2023-07-24 16:07:15,576 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33229,1690214755329' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-24 16:07:15,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:15,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:15,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:15,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:15,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:15,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:15,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:15,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:15,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:15,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:15,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:15,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:15,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38047,1690214755282': 2023-07-24 16:07:15,581 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38047,1690214755282' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-24 16:07:15,581 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-24 16:07:15,582 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 16:07:15,582 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 16:07:15,582 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,582 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 16:07:15,584 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,584 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:15,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:15,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,584 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,584 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,584 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,584 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:15,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:15,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,584 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:15,584 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:15,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:15,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:15,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:15,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:15,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:15,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:15,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,585 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:15,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:15,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,586 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:15,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,587 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:15,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:15,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:15,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:15,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:15,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,588 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:15,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:15,589 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:15,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:15,589 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:15,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:15,592 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:15,593 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:15,592 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:15,593 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:15,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:15,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:15,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:15,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:15,593 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:15,593 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:15,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:15,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:15,593 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:15,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:15,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:15,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:15,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:15,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:15,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:15,595 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,595 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:15,595 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:15,595 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,595 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:15,595 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,595 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:15,595 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,595 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:15,597 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,597 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:15,597 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,598 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,597 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,598 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 16:07:15,599 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 16:07:15,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,623 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,701 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:07:15,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 16:07:15,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 16:07:15,703 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 16:07:15,724 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,746 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-24 16:07:15,791 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-24 16:07:15,791 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,792 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:15,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690214835386Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1690214835622 (+236 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690214835622Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690214835623 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690214835632 (+9 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690214835709 (+77 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690214835791 (+82 ms) 2023-07-24 16:07:15,795 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 16:07:15,797 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 408 msec 2023-07-24 16:07:16,003 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:07:16,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 16:07:16,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 16:07:16,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33229] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 16:07:16,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38047] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 16:07:16,016 DEBUG [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,016 DEBUG [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1. 2023-07-24 16:07:16,016 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 16:07:16,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 16:07:16,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690214836027 (current time:1690214836027). 2023-07-24 16:07:16,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 16:07:16,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(139): Connect 0x30d9a98a to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:07:16,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@101f54ef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:07:16,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:07:16,040 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39582, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:07:16,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x30d9a98a to 127.0.0.1:49766 2023-07-24 16:07:16,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:07:16,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(139): Connect 0x7ee99baf to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:07:16,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@301e801, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:07:16,052 DEBUG [hconnection-0x69d36ca2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:07:16,055 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39586, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:07:16,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ee99baf to 127.0.0.1:49766 2023-07-24 16:07:16,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:07:16,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 16:07:16,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 16:07:16,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 16:07:16,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 16:07:16,065 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 16:07:16,066 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690215436066 2023-07-24 16:07:16,066 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 16:07:16,068 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 16:07:16,068 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 16:07:16,068 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 16:07:16,069 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 16:07:16,078 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-24 16:07:16,080 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 16:07:16,081 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690215436081 2023-07-24 16:07:16,169 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:07:16,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 16:07:16,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 16:07:16,171 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 16:07:16,371 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:07:16,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 16:07:16,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 16:07:16,373 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 16:07:16,498 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,498 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-24 16:07:16,498 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:16,498 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-24 16:07:16,498 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-24 16:07:16,499 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,499 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,501 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:16,501 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:16,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:16,502 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:16,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:16,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:16,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:16,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:16,502 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:16,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:16,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,503 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,503 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,504 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:16,504 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:16,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 16:07:16,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 16:07:16,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,504 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 16:07:16,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,505 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 16:07:16,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 16:07:16,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,505 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:16,506 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 16:07:16,506 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 16:07:16,515 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,515 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 16:07:16,515 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:16,521 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,521 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,521 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 16:07:16,521 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 16:07:16,521 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:16,524 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 16:07:16,525 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 16:07:16,525 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38047,1690214755282' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 16:07:16,525 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 16:07:16,525 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 16:07:16,526 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33053,1690214755222' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 16:07:16,524 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:16,527 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 16:07:16,527 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 16:07:16,527 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33229,1690214755329' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 16:07:16,529 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:16,529 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:16,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:16,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:16,530 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,530 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:07:16,530 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,531 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:16,531 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,531 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:16,531 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:07:16,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:16,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,532 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,532 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:07:16,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:16,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:16,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:16,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:16,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,38047,1690214755282' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 16:07:16,534 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@658c8264[Count = 1] remaining members to acquire global barrier 2023-07-24 16:07:16,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:16,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:16,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:16,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:16,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:16,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:16,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:16,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:16,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:16,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33229,1690214755329' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 16:07:16,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@658c8264[Count = 0] remaining members to acquire global barrier 2023-07-24 16:07:16,545 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-24 16:07:16,545 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,547 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,547 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,547 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,547 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:16,547 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 16:07:16,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,548 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 16:07:16,548 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:16,548 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 16:07:16,548 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 16:07:16,548 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 16:07:16,548 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33053,1690214755222' in zk 2023-07-24 16:07:16,551 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 16:07:16,551 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 16:07:16,551 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312. 2023-07-24 16:07:16,551 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312. started... 2023-07-24 16:07:16,551 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 16:07:16,551 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:16,551 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 16:07:16,551 INFO [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] regionserver.HRegion(2745): Flushing db873e25934e7aeaaf59bd533066d312 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-24 16:07:16,553 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 16:07:16,553 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 16:07:16,553 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1. 2023-07-24 16:07:16,553 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1. started... 2023-07-24 16:07:16,553 INFO [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2716c94bbe510883ffbf1d5f775097f1 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-24 16:07:16,654 INFO [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230724267d3f65ce464ed08eb7f98f251ff67c to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230724267d3f65ce464ed08eb7f98f251ff67c 2023-07-24 16:07:16,673 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:07:16,673 INFO [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion/2716c94bbe510883ffbf1d5f775097f1/.tmp/cf/4eaf3dab51ca42c3bf9085b59ef3d517 2023-07-24 16:07:16,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 16:07:16,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 16:07:16,674 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 16:07:16,681 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion/2716c94bbe510883ffbf1d5f775097f1/.tmp/cf/4eaf3dab51ca42c3bf9085b59ef3d517 as hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion/2716c94bbe510883ffbf1d5f775097f1/cf/4eaf3dab51ca42c3bf9085b59ef3d517 2023-07-24 16:07:16,689 INFO [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion/2716c94bbe510883ffbf1d5f775097f1/cf/4eaf3dab51ca42c3bf9085b59ef3d517, entries=1, sequenceid=6, filesize=5.1 K 2023-07-24 16:07:16,691 INFO [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 2716c94bbe510883ffbf1d5f775097f1 in 138ms, sequenceid=6, compaction requested=false 2023-07-24 16:07:16,692 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2716c94bbe510883ffbf1d5f775097f1: 2023-07-24 16:07:16,693 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,693 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 16:07:16,693 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion/2716c94bbe510883ffbf1d5f775097f1/cf/4eaf3dab51ca42c3bf9085b59ef3d517] hfiles 2023-07-24 16:07:16,693 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion/2716c94bbe510883ffbf1d5f775097f1/cf/4eaf3dab51ca42c3bf9085b59ef3d517 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,712 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1. completed. 2023-07-24 16:07:16,712 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1. 2023-07-24 16:07:16,712 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 16:07:16,712 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 16:07:16,712 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:16,712 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 16:07:16,712 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33229,1690214755329' in zk 2023-07-24 16:07:16,715 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:16,715 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 16:07:16,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:16,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:16,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:16,715 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:16,715 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 16:07:16,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:16,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:16,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:16,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:16,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:16,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:16,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:16,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:16,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:16,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33229,1690214755329': 2023-07-24 16:07:16,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33229,1690214755329' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-24 16:07:17,073 INFO [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230724e6ac502e612546828d6874e37ba2557f to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230724e6ac502e612546828d6874e37ba2557f 2023-07-24 16:07:17,130 INFO [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion/db873e25934e7aeaaf59bd533066d312/.tmp/cf/28843d092fd646c8a96a0b8e56deb1c8 2023-07-24 16:07:17,141 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion/db873e25934e7aeaaf59bd533066d312/.tmp/cf/28843d092fd646c8a96a0b8e56deb1c8 as hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion/db873e25934e7aeaaf59bd533066d312/cf/28843d092fd646c8a96a0b8e56deb1c8 2023-07-24 16:07:17,155 INFO [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion/db873e25934e7aeaaf59bd533066d312/cf/28843d092fd646c8a96a0b8e56deb1c8, entries=49, sequenceid=6, filesize=13.9 K 2023-07-24 16:07:17,158 INFO [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for db873e25934e7aeaaf59bd533066d312 in 607ms, sequenceid=6, compaction requested=false 2023-07-24 16:07:17,158 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for db873e25934e7aeaaf59bd533066d312: 2023-07-24 16:07:17,158 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,158 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 16:07:17,158 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion/db873e25934e7aeaaf59bd533066d312/cf/28843d092fd646c8a96a0b8e56deb1c8] hfiles 2023-07-24 16:07:17,158 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion/db873e25934e7aeaaf59bd533066d312/cf/28843d092fd646c8a96a0b8e56deb1c8 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,175 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:07:17,175 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312. completed. 2023-07-24 16:07:17,175 DEBUG [rs(jenkins-hbase4.apache.org,38047,1690214755282)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312. 2023-07-24 16:07:17,175 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 16:07:17,175 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 16:07:17,175 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:17,175 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 16:07:17,175 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,38047,1690214755282' in zk 2023-07-24 16:07:17,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 16:07:17,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 16:07:17,176 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-24 16:07:17,178 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:17,178 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 16:07:17,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:17,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:17,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:17,178 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:17,179 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 16:07:17,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:17,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:17,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:17,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:17,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:17,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:17,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:17,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:17,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:17,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,38047,1690214755282': 2023-07-24 16:07:17,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,38047,1690214755282' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-24 16:07:17,188 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-24 16:07:17,188 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 16:07:17,188 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 16:07:17,188 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,188 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 16:07:17,194 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,194 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:17,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,194 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,195 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:17,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,195 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,195 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:17,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:17,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:17,195 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:17,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:17,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:17,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:17,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:17,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:17,196 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:17,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,197 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:17,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:17,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,197 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:17,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:17,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:17,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:17,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:17,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:17,200 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:17,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,201 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:17,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:17,201 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:17,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:17,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:17,206 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:17,206 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:17,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:17,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:17,206 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:17,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:17,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:17,207 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:17,207 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:17,207 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:17,207 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:17,207 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,207 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:17,207 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:17,207 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,207 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:17,207 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,207 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,207 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,207 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 16:07:17,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:17,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:17,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:17,207 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:17,208 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:17,208 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,208 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:17,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:17,208 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230724e6ac502e612546828d6874e37ba2557f, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230724267d3f65ce464ed08eb7f98f251ff67c] mob files 2023-07-24 16:07:17,208 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230724e6ac502e612546828d6874e37ba2557f 2023-07-24 16:07:17,209 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230724267d3f65ce464ed08eb7f98f251ff67c 2023-07-24 16:07:17,207 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:17,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:17,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:17,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:17,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,306 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-24 16:07:17,306 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,306 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:17,306 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690214836066Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1690214837239 (+1173 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690214837239Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1690214837239Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1690214837245 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690214837263 (+18 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690214837306 (+43 ms) 2023-07-24 16:07:17,309 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 16:07:17,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 1.2430 sec 2023-07-24 16:07:18,177 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:07:18,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 16:07:18,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 16:07:18,209 DEBUG [Listener at jenkins-hbase4.apache.org/42941] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 16:07:18,217 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50136, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 16:07:18,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33053] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 16:07:18,220 DEBUG [Listener at jenkins-hbase4.apache.org/42941] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 16:07:18,227 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39590, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 16:07:18,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33229] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 16:07:18,228 DEBUG [Listener at jenkins-hbase4.apache.org/42941] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 16:07:18,229 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40338, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 16:07:18,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38047] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 16:07:18,232 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 16:07:18,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:18,236 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 16:07:18,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-24 16:07:18,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 16:07:18,240 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 16:07:18,243 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b72c1954ba520f9b50ef3138b4934a7c 2023-07-24 16:07:18,243 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/660ec2e513f53b2a71948e5a44d6a6c6 2023-07-24 16:07:18,243 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b72c1954ba520f9b50ef3138b4934a7c empty. 2023-07-24 16:07:18,244 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/660ec2e513f53b2a71948e5a44d6a6c6 empty. 2023-07-24 16:07:18,244 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b72c1954ba520f9b50ef3138b4934a7c 2023-07-24 16:07:18,244 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/660ec2e513f53b2a71948e5a44d6a6c6 2023-07-24 16:07:18,244 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-24 16:07:18,319 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-24 16:07:18,321 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 660ec2e513f53b2a71948e5a44d6a6c6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690214838232.660ec2e513f53b2a71948e5a44d6a6c6.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp 2023-07-24 16:07:18,321 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => b72c1954ba520f9b50ef3138b4934a7c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838232.b72c1954ba520f9b50ef3138b4934a7c.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp 2023-07-24 16:07:18,331 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838232.b72c1954ba520f9b50ef3138b4934a7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:07:18,331 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing b72c1954ba520f9b50ef3138b4934a7c, disabling compactions & flushes 2023-07-24 16:07:18,331 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838232.b72c1954ba520f9b50ef3138b4934a7c. 2023-07-24 16:07:18,331 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838232.b72c1954ba520f9b50ef3138b4934a7c. 2023-07-24 16:07:18,331 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838232.b72c1954ba520f9b50ef3138b4934a7c. after waiting 0 ms 2023-07-24 16:07:18,331 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838232.b72c1954ba520f9b50ef3138b4934a7c. 2023-07-24 16:07:18,331 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838232.b72c1954ba520f9b50ef3138b4934a7c. 2023-07-24 16:07:18,331 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for b72c1954ba520f9b50ef3138b4934a7c: 2023-07-24 16:07:18,333 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690214838232.660ec2e513f53b2a71948e5a44d6a6c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:07:18,333 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 660ec2e513f53b2a71948e5a44d6a6c6, disabling compactions & flushes 2023-07-24 16:07:18,333 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690214838232.660ec2e513f53b2a71948e5a44d6a6c6. 2023-07-24 16:07:18,333 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690214838232.660ec2e513f53b2a71948e5a44d6a6c6. 2023-07-24 16:07:18,333 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690214838232.660ec2e513f53b2a71948e5a44d6a6c6. after waiting 0 ms 2023-07-24 16:07:18,333 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690214838232.660ec2e513f53b2a71948e5a44d6a6c6. 2023-07-24 16:07:18,333 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690214838232.660ec2e513f53b2a71948e5a44d6a6c6. 2023-07-24 16:07:18,333 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 660ec2e513f53b2a71948e5a44d6a6c6: 2023-07-24 16:07:18,336 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 16:07:18,337 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838232.b72c1954ba520f9b50ef3138b4934a7c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690214838337"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214838337"}]},"ts":"1690214838337"} 2023-07-24 16:07:18,337 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690214838232.660ec2e513f53b2a71948e5a44d6a6c6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690214838337"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214838337"}]},"ts":"1690214838337"} 2023-07-24 16:07:18,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 16:07:18,339 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 16:07:18,340 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 16:07:18,340 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214838340"}]},"ts":"1690214838340"} 2023-07-24 16:07:18,342 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-24 16:07:18,457 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 16:07:18,458 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 16:07:18,458 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 16:07:18,459 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 16:07:18,459 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 16:07:18,459 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b72c1954ba520f9b50ef3138b4934a7c, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=660ec2e513f53b2a71948e5a44d6a6c6, ASSIGN}] 2023-07-24 16:07:18,482 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b72c1954ba520f9b50ef3138b4934a7c, ASSIGN 2023-07-24 16:07:18,483 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=660ec2e513f53b2a71948e5a44d6a6c6, ASSIGN 2023-07-24 16:07:18,483 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b72c1954ba520f9b50ef3138b4934a7c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33229,1690214755329; forceNewPlan=false, retain=false 2023-07-24 16:07:18,484 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=660ec2e513f53b2a71948e5a44d6a6c6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38047,1690214755282; forceNewPlan=false, retain=false 2023-07-24 16:07:18,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 16:07:18,634 INFO [jenkins-hbase4:43489] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 16:07:18,637 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=b72c1954ba520f9b50ef3138b4934a7c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:18,637 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=660ec2e513f53b2a71948e5a44d6a6c6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:18,637 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838232.b72c1954ba520f9b50ef3138b4934a7c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690214838637"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214838637"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214838637"}]},"ts":"1690214838637"} 2023-07-24 16:07:18,638 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690214838232.660ec2e513f53b2a71948e5a44d6a6c6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690214838637"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214838637"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214838637"}]},"ts":"1690214838637"} 2023-07-24 16:07:18,639 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure b72c1954ba520f9b50ef3138b4934a7c, server=jenkins-hbase4.apache.org,33229,1690214755329}] 2023-07-24 16:07:18,640 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 660ec2e513f53b2a71948e5a44d6a6c6, server=jenkins-hbase4.apache.org,38047,1690214755282}] 2023-07-24 16:07:18,710 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0004_000001 (auth:SIMPLE) 2023-07-24 16:07:18,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1690214838232.660ec2e513f53b2a71948e5a44d6a6c6. 2023-07-24 16:07:18,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838232.b72c1954ba520f9b50ef3138b4934a7c. 2023-07-24 16:07:18,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 660ec2e513f53b2a71948e5a44d6a6c6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690214838232.660ec2e513f53b2a71948e5a44d6a6c6.', STARTKEY => '2', ENDKEY => ''} 2023-07-24 16:07:18,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b72c1954ba520f9b50ef3138b4934a7c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838232.b72c1954ba520f9b50ef3138b4934a7c.', STARTKEY => '', ENDKEY => '2'} 2023-07-24 16:07:18,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1690214838232.660ec2e513f53b2a71948e5a44d6a6c6. service=AccessControlService 2023-07-24 16:07:18,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838232.b72c1954ba520f9b50ef3138b4934a7c. service=AccessControlService 2023-07-24 16:07:18,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 16:07:18,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 660ec2e513f53b2a71948e5a44d6a6c6 2023-07-24 16:07:18,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 16:07:18,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690214838232.660ec2e513f53b2a71948e5a44d6a6c6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:07:18,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 660ec2e513f53b2a71948e5a44d6a6c6 2023-07-24 16:07:18,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 b72c1954ba520f9b50ef3138b4934a7c 2023-07-24 16:07:18,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 660ec2e513f53b2a71948e5a44d6a6c6 2023-07-24 16:07:18,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838232.b72c1954ba520f9b50ef3138b4934a7c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:07:18,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b72c1954ba520f9b50ef3138b4934a7c 2023-07-24 16:07:18,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b72c1954ba520f9b50ef3138b4934a7c 2023-07-24 16:07:18,838 INFO [StoreOpener-660ec2e513f53b2a71948e5a44d6a6c6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 660ec2e513f53b2a71948e5a44d6a6c6 2023-07-24 16:07:18,838 INFO [StoreOpener-b72c1954ba520f9b50ef3138b4934a7c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b72c1954ba520f9b50ef3138b4934a7c 2023-07-24 16:07:18,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 16:07:18,858 DEBUG [StoreOpener-660ec2e513f53b2a71948e5a44d6a6c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/660ec2e513f53b2a71948e5a44d6a6c6/cf 2023-07-24 16:07:18,859 DEBUG [StoreOpener-660ec2e513f53b2a71948e5a44d6a6c6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/660ec2e513f53b2a71948e5a44d6a6c6/cf 2023-07-24 16:07:18,858 DEBUG [StoreOpener-b72c1954ba520f9b50ef3138b4934a7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b72c1954ba520f9b50ef3138b4934a7c/cf 2023-07-24 16:07:18,859 DEBUG [StoreOpener-b72c1954ba520f9b50ef3138b4934a7c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b72c1954ba520f9b50ef3138b4934a7c/cf 2023-07-24 16:07:18,859 INFO [StoreOpener-b72c1954ba520f9b50ef3138b4934a7c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b72c1954ba520f9b50ef3138b4934a7c columnFamilyName cf 2023-07-24 16:07:18,859 INFO [StoreOpener-660ec2e513f53b2a71948e5a44d6a6c6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 660ec2e513f53b2a71948e5a44d6a6c6 columnFamilyName cf 2023-07-24 16:07:18,860 INFO [StoreOpener-b72c1954ba520f9b50ef3138b4934a7c-1] regionserver.HStore(310): Store=b72c1954ba520f9b50ef3138b4934a7c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 16:07:18,860 INFO [StoreOpener-660ec2e513f53b2a71948e5a44d6a6c6-1] regionserver.HStore(310): Store=660ec2e513f53b2a71948e5a44d6a6c6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 16:07:18,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b72c1954ba520f9b50ef3138b4934a7c 2023-07-24 16:07:18,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/660ec2e513f53b2a71948e5a44d6a6c6 2023-07-24 16:07:18,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b72c1954ba520f9b50ef3138b4934a7c 2023-07-24 16:07:18,861 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/660ec2e513f53b2a71948e5a44d6a6c6 2023-07-24 16:07:18,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 660ec2e513f53b2a71948e5a44d6a6c6 2023-07-24 16:07:18,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b72c1954ba520f9b50ef3138b4934a7c 2023-07-24 16:07:18,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/660ec2e513f53b2a71948e5a44d6a6c6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 16:07:18,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b72c1954ba520f9b50ef3138b4934a7c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 16:07:18,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b72c1954ba520f9b50ef3138b4934a7c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65232781, jitterRate=-0.027955815196037292}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 16:07:18,866 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 660ec2e513f53b2a71948e5a44d6a6c6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64030244, jitterRate=-0.04587501287460327}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 16:07:18,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b72c1954ba520f9b50ef3138b4934a7c: 2023-07-24 16:07:18,866 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 660ec2e513f53b2a71948e5a44d6a6c6: 2023-07-24 16:07:18,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690214838232.660ec2e513f53b2a71948e5a44d6a6c6., pid=70, masterSystemTime=1690214838833 2023-07-24 16:07:18,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838232.b72c1954ba520f9b50ef3138b4934a7c., pid=69, masterSystemTime=1690214838833 2023-07-24 16:07:18,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838232.b72c1954ba520f9b50ef3138b4934a7c. 2023-07-24 16:07:18,869 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838232.b72c1954ba520f9b50ef3138b4934a7c. 2023-07-24 16:07:18,869 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=b72c1954ba520f9b50ef3138b4934a7c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:18,869 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838232.b72c1954ba520f9b50ef3138b4934a7c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690214838869"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690214838869"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690214838869"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690214838869"}]},"ts":"1690214838869"} 2023-07-24 16:07:18,869 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690214838232.660ec2e513f53b2a71948e5a44d6a6c6. 2023-07-24 16:07:18,870 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1690214838232.660ec2e513f53b2a71948e5a44d6a6c6. 2023-07-24 16:07:18,870 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=660ec2e513f53b2a71948e5a44d6a6c6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:18,870 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690214838232.660ec2e513f53b2a71948e5a44d6a6c6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690214838870"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690214838870"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690214838870"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690214838870"}]},"ts":"1690214838870"} 2023-07-24 16:07:18,873 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-07-24 16:07:18,873 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure b72c1954ba520f9b50ef3138b4934a7c, server=jenkins-hbase4.apache.org,33229,1690214755329 in 232 msec 2023-07-24 16:07:18,874 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=68 2023-07-24 16:07:18,874 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 660ec2e513f53b2a71948e5a44d6a6c6, server=jenkins-hbase4.apache.org,38047,1690214755282 in 232 msec 2023-07-24 16:07:18,874 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b72c1954ba520f9b50ef3138b4934a7c, ASSIGN in 414 msec 2023-07-24 16:07:18,876 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-24 16:07:18,876 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=660ec2e513f53b2a71948e5a44d6a6c6, ASSIGN in 415 msec 2023-07-24 16:07:18,876 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 16:07:18,876 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214838876"}]},"ts":"1690214838876"} 2023-07-24 16:07:18,877 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-24 16:07:18,911 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 16:07:18,912 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-24 16:07:18,913 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33229] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-24 16:07:18,933 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:18,933 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:18,933 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:18,933 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:18,996 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 16:07:18,996 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 16:07:18,996 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 16:07:18,996 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 16:07:18,996 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 16:07:18,996 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 16:07:18,996 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 16:07:18,996 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 16:07:19,012 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 763 msec 2023-07-24 16:07:19,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 16:07:19,343 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-24 16:07:19,378 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions b72c1954ba520f9b50ef3138b4934a7c, 660ec2e513f53b2a71948e5a44d6a6c6 2023-07-24 16:07:19,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b72c1954ba520f9b50ef3138b4934a7c, 660ec2e513f53b2a71948e5a44d6a6c6], force=true 2023-07-24 16:07:19,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 16:07:19,394 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b72c1954ba520f9b50ef3138b4934a7c, 660ec2e513f53b2a71948e5a44d6a6c6], force=true 2023-07-24 16:07:19,394 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b72c1954ba520f9b50ef3138b4934a7c, 660ec2e513f53b2a71948e5a44d6a6c6], force=true 2023-07-24 16:07:19,395 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b72c1954ba520f9b50ef3138b4934a7c, 660ec2e513f53b2a71948e5a44d6a6c6], force=true 2023-07-24 16:07:19,419 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b72c1954ba520f9b50ef3138b4934a7c, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=660ec2e513f53b2a71948e5a44d6a6c6, UNASSIGN}] 2023-07-24 16:07:19,429 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b72c1954ba520f9b50ef3138b4934a7c, UNASSIGN 2023-07-24 16:07:19,429 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=660ec2e513f53b2a71948e5a44d6a6c6, UNASSIGN 2023-07-24 16:07:19,430 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=660ec2e513f53b2a71948e5a44d6a6c6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:19,430 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=b72c1954ba520f9b50ef3138b4934a7c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:19,430 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690214838232.660ec2e513f53b2a71948e5a44d6a6c6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690214839430"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214839430"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214839430"}]},"ts":"1690214839430"} 2023-07-24 16:07:19,430 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838232.b72c1954ba520f9b50ef3138b4934a7c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690214839430"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214839430"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214839430"}]},"ts":"1690214839430"} 2023-07-24 16:07:19,433 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 660ec2e513f53b2a71948e5a44d6a6c6, server=jenkins-hbase4.apache.org,38047,1690214755282}] 2023-07-24 16:07:19,433 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure b72c1954ba520f9b50ef3138b4934a7c, server=jenkins-hbase4.apache.org,33229,1690214755329}] 2023-07-24 16:07:19,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 16:07:19,602 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b72c1954ba520f9b50ef3138b4934a7c 2023-07-24 16:07:19,602 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 660ec2e513f53b2a71948e5a44d6a6c6 2023-07-24 16:07:19,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b72c1954ba520f9b50ef3138b4934a7c, disabling compactions & flushes 2023-07-24 16:07:19,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838232.b72c1954ba520f9b50ef3138b4934a7c. 2023-07-24 16:07:19,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838232.b72c1954ba520f9b50ef3138b4934a7c. 2023-07-24 16:07:19,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838232.b72c1954ba520f9b50ef3138b4934a7c. after waiting 0 ms 2023-07-24 16:07:19,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 660ec2e513f53b2a71948e5a44d6a6c6, disabling compactions & flushes 2023-07-24 16:07:19,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838232.b72c1954ba520f9b50ef3138b4934a7c. 2023-07-24 16:07:19,606 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690214838232.660ec2e513f53b2a71948e5a44d6a6c6. 2023-07-24 16:07:19,606 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing b72c1954ba520f9b50ef3138b4934a7c 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-24 16:07:19,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690214838232.660ec2e513f53b2a71948e5a44d6a6c6. 2023-07-24 16:07:19,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690214838232.660ec2e513f53b2a71948e5a44d6a6c6. after waiting 0 ms 2023-07-24 16:07:19,606 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690214838232.660ec2e513f53b2a71948e5a44d6a6c6. 2023-07-24 16:07:19,606 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 660ec2e513f53b2a71948e5a44d6a6c6 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-24 16:07:19,627 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/660ec2e513f53b2a71948e5a44d6a6c6/.tmp/cf/4fa67ec143cc4a4abb73be4468ca0e78 2023-07-24 16:07:19,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/660ec2e513f53b2a71948e5a44d6a6c6/.tmp/cf/4fa67ec143cc4a4abb73be4468ca0e78 as hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/660ec2e513f53b2a71948e5a44d6a6c6/cf/4fa67ec143cc4a4abb73be4468ca0e78 2023-07-24 16:07:19,636 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b72c1954ba520f9b50ef3138b4934a7c/.tmp/cf/9335497615ae4473a6d33207b6e71356 2023-07-24 16:07:19,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/660ec2e513f53b2a71948e5a44d6a6c6/cf/4fa67ec143cc4a4abb73be4468ca0e78, entries=1, sequenceid=5, filesize=4.7 K 2023-07-24 16:07:19,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b72c1954ba520f9b50ef3138b4934a7c/.tmp/cf/9335497615ae4473a6d33207b6e71356 as hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b72c1954ba520f9b50ef3138b4934a7c/cf/9335497615ae4473a6d33207b6e71356 2023-07-24 16:07:19,655 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b72c1954ba520f9b50ef3138b4934a7c/cf/9335497615ae4473a6d33207b6e71356, entries=1, sequenceid=5, filesize=4.7 K 2023-07-24 16:07:19,657 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 660ec2e513f53b2a71948e5a44d6a6c6 in 51ms, sequenceid=5, compaction requested=false 2023-07-24 16:07:19,657 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-24 16:07:19,668 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for b72c1954ba520f9b50ef3138b4934a7c in 62ms, sequenceid=5, compaction requested=false 2023-07-24 16:07:19,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/660ec2e513f53b2a71948e5a44d6a6c6/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-24 16:07:19,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:07:19,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690214838232.660ec2e513f53b2a71948e5a44d6a6c6. 2023-07-24 16:07:19,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 660ec2e513f53b2a71948e5a44d6a6c6: 2023-07-24 16:07:19,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 660ec2e513f53b2a71948e5a44d6a6c6 2023-07-24 16:07:19,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b72c1954ba520f9b50ef3138b4934a7c/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-24 16:07:19,680 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:07:19,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838232.b72c1954ba520f9b50ef3138b4934a7c. 2023-07-24 16:07:19,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b72c1954ba520f9b50ef3138b4934a7c: 2023-07-24 16:07:19,682 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=660ec2e513f53b2a71948e5a44d6a6c6, regionState=CLOSED 2023-07-24 16:07:19,682 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690214838232.660ec2e513f53b2a71948e5a44d6a6c6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690214839682"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214839682"}]},"ts":"1690214839682"} 2023-07-24 16:07:19,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b72c1954ba520f9b50ef3138b4934a7c 2023-07-24 16:07:19,686 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=b72c1954ba520f9b50ef3138b4934a7c, regionState=CLOSED 2023-07-24 16:07:19,686 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838232.b72c1954ba520f9b50ef3138b4934a7c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690214839686"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214839686"}]},"ts":"1690214839686"} 2023-07-24 16:07:19,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 16:07:19,696 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-24 16:07:19,696 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 660ec2e513f53b2a71948e5a44d6a6c6, server=jenkins-hbase4.apache.org,38047,1690214755282 in 255 msec 2023-07-24 16:07:19,696 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-24 16:07:19,696 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure b72c1954ba520f9b50ef3138b4934a7c, server=jenkins-hbase4.apache.org,33229,1690214755329 in 257 msec 2023-07-24 16:07:19,700 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=660ec2e513f53b2a71948e5a44d6a6c6, UNASSIGN in 277 msec 2023-07-24 16:07:19,701 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-24 16:07:19,701 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b72c1954ba520f9b50ef3138b4934a7c, UNASSIGN in 280 msec 2023-07-24 16:07:19,799 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f513ef78d5597df1e05f7b2f04bbef0d/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-24 16:07:19,801 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838232.b72c1954ba520f9b50ef3138b4934a7c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 16:07:19,801 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690214838232.660ec2e513f53b2a71948e5a44d6a6c6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 16:07:19,802 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838233.f513ef78d5597df1e05f7b2f04bbef0d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 16:07:19,875 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f513ef78d5597df1e05f7b2f04bbef0d, ASSIGN}] 2023-07-24 16:07:19,876 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f513ef78d5597df1e05f7b2f04bbef0d, ASSIGN 2023-07-24 16:07:19,878 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f513ef78d5597df1e05f7b2f04bbef0d, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,33229,1690214755329; forceNewPlan=false, retain=false 2023-07-24 16:07:19,928 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 16:07:19,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 16:07:20,028 INFO [jenkins-hbase4:43489] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 16:07:20,030 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=f513ef78d5597df1e05f7b2f04bbef0d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:20,030 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838233.f513ef78d5597df1e05f7b2f04bbef0d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690214840030"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214840030"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214840030"}]},"ts":"1690214840030"} 2023-07-24 16:07:20,037 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure f513ef78d5597df1e05f7b2f04bbef0d, server=jenkins-hbase4.apache.org,33229,1690214755329}] 2023-07-24 16:07:20,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838233.f513ef78d5597df1e05f7b2f04bbef0d. 2023-07-24 16:07:20,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f513ef78d5597df1e05f7b2f04bbef0d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838233.f513ef78d5597df1e05f7b2f04bbef0d.', STARTKEY => '', ENDKEY => ''} 2023-07-24 16:07:20,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838233.f513ef78d5597df1e05f7b2f04bbef0d. service=AccessControlService 2023-07-24 16:07:20,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 16:07:20,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 f513ef78d5597df1e05f7b2f04bbef0d 2023-07-24 16:07:20,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838233.f513ef78d5597df1e05f7b2f04bbef0d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:07:20,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f513ef78d5597df1e05f7b2f04bbef0d 2023-07-24 16:07:20,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f513ef78d5597df1e05f7b2f04bbef0d 2023-07-24 16:07:20,196 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f513ef78d5597df1e05f7b2f04bbef0d/.regioninfo 2023-07-24 16:07:20,208 INFO [StoreOpener-f513ef78d5597df1e05f7b2f04bbef0d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f513ef78d5597df1e05f7b2f04bbef0d 2023-07-24 16:07:20,208 DEBUG [StoreOpener-f513ef78d5597df1e05f7b2f04bbef0d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f513ef78d5597df1e05f7b2f04bbef0d/cf 2023-07-24 16:07:20,209 DEBUG [StoreOpener-f513ef78d5597df1e05f7b2f04bbef0d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f513ef78d5597df1e05f7b2f04bbef0d/cf 2023-07-24 16:07:20,209 INFO [StoreOpener-f513ef78d5597df1e05f7b2f04bbef0d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f513ef78d5597df1e05f7b2f04bbef0d columnFamilyName cf 2023-07-24 16:07:20,265 DEBUG [StoreOpener-f513ef78d5597df1e05f7b2f04bbef0d-1] regionserver.HStore(539): loaded hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f513ef78d5597df1e05f7b2f04bbef0d/cf/4fa67ec143cc4a4abb73be4468ca0e78.660ec2e513f53b2a71948e5a44d6a6c6->hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/660ec2e513f53b2a71948e5a44d6a6c6/cf/4fa67ec143cc4a4abb73be4468ca0e78-top 2023-07-24 16:07:20,282 DEBUG [StoreOpener-f513ef78d5597df1e05f7b2f04bbef0d-1] regionserver.HStore(539): loaded hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f513ef78d5597df1e05f7b2f04bbef0d/cf/9335497615ae4473a6d33207b6e71356.b72c1954ba520f9b50ef3138b4934a7c->hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b72c1954ba520f9b50ef3138b4934a7c/cf/9335497615ae4473a6d33207b6e71356-top 2023-07-24 16:07:20,282 INFO [StoreOpener-f513ef78d5597df1e05f7b2f04bbef0d-1] regionserver.HStore(310): Store=f513ef78d5597df1e05f7b2f04bbef0d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 16:07:20,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f513ef78d5597df1e05f7b2f04bbef0d 2023-07-24 16:07:20,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f513ef78d5597df1e05f7b2f04bbef0d 2023-07-24 16:07:20,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f513ef78d5597df1e05f7b2f04bbef0d 2023-07-24 16:07:20,289 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f513ef78d5597df1e05f7b2f04bbef0d; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68536146, jitterRate=0.02126815915107727}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 16:07:20,289 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f513ef78d5597df1e05f7b2f04bbef0d: 2023-07-24 16:07:20,290 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838233.f513ef78d5597df1e05f7b2f04bbef0d., pid=77, masterSystemTime=1690214840190 2023-07-24 16:07:20,290 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838233.f513ef78d5597df1e05f7b2f04bbef0d.,because compaction is disabled. 2023-07-24 16:07:20,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838233.f513ef78d5597df1e05f7b2f04bbef0d. 2023-07-24 16:07:20,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838233.f513ef78d5597df1e05f7b2f04bbef0d. 2023-07-24 16:07:20,292 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=f513ef78d5597df1e05f7b2f04bbef0d, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:20,293 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838233.f513ef78d5597df1e05f7b2f04bbef0d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690214840292"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690214840292"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690214840292"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690214840292"}]},"ts":"1690214840292"} 2023-07-24 16:07:20,296 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-24 16:07:20,296 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure f513ef78d5597df1e05f7b2f04bbef0d, server=jenkins-hbase4.apache.org,33229,1690214755329 in 257 msec 2023-07-24 16:07:20,297 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-24 16:07:20,298 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f513ef78d5597df1e05f7b2f04bbef0d, ASSIGN in 421 msec 2023-07-24 16:07:20,299 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[b72c1954ba520f9b50ef3138b4934a7c, 660ec2e513f53b2a71948e5a44d6a6c6], force=true in 915 msec 2023-07-24 16:07:20,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 16:07:20,497 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-24 16:07:20,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 16:07:20,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690214840498 (current time:1690214840498). 2023-07-24 16:07:20,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 16:07:20,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(139): Connect 0x420ca6bc to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:07:20,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4519deec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:07:20,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:07:20,510 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41062, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:07:20,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x420ca6bc to 127.0.0.1:49766 2023-07-24 16:07:20,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:07:20,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(139): Connect 0x547974f5 to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:07:20,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73670180, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:07:20,523 DEBUG [hconnection-0x78825fbe-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:07:20,524 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41076, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:07:20,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x547974f5 to 127.0.0.1:49766 2023-07-24 16:07:20,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:07:20,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-24 16:07:20,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 16:07:20,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 16:07:20,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 16:07:20,543 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 16:07:20,543 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1690215440543 2023-07-24 16:07:20,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 16:07:20,543 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,547 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 16:07:20,547 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 16:07:20,548 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 16:07:20,549 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 16:07:20,550 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 8 msec 2023-07-24 16:07:20,551 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 16:07:20,552 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1690215440552 2023-07-24 16:07:20,570 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,570 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-24 16:07:20,570 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:20,572 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-24 16:07:20,572 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-24 16:07:20,573 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,573 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,574 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:20,575 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:20,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:20,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:20,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:20,575 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:20,575 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:20,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:20,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:20,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:20,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,575 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:20,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,576 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 16:07:20,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,576 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,576 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,576 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 16:07:20,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 16:07:20,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,577 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 16:07:20,577 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 16:07:20,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 16:07:20,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,577 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 16:07:20,584 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,584 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 16:07:20,584 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:20,587 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,587 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 16:07:20,587 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:20,590 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,592 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 16:07:20,592 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 16:07:20,592 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 16:07:20,593 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38047,1690214755282' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 16:07:20,592 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 16:07:20,593 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33229,1690214755329' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 16:07:20,594 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 16:07:20,594 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:20,596 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 16:07:20,596 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 16:07:20,596 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33053,1690214755222' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 16:07:20,603 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,603 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:20,603 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:20,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:20,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:20,604 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:20,605 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,605 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:07:20,605 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:07:20,605 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:20,605 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,605 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:07:20,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:20,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:20,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:20,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:20,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33229,1690214755329' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-24 16:07:20,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@365083c6[Count = 0] remaining members to acquire global barrier 2023-07-24 16:07:20,608 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-24 16:07:20,608 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,611 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,611 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,611 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,611 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:20,612 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 16:07:20,611 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 16:07:20,612 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 16:07:20,611 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 16:07:20,612 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 16:07:20,612 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,38047,1690214755282' in zk 2023-07-24 16:07:20,612 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 16:07:20,612 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,33053,1690214755222' in zk 2023-07-24 16:07:20,614 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 16:07:20,614 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:20,614 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 16:07:20,614 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 16:07:20,614 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 16:07:20,614 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 16:07:20,616 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838233.f513ef78d5597df1e05f7b2f04bbef0d. 2023-07-24 16:07:20,616 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:20,617 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838233.f513ef78d5597df1e05f7b2f04bbef0d. started... 2023-07-24 16:07:20,617 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 16:07:20,622 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f513ef78d5597df1e05f7b2f04bbef0d: 2023-07-24 16:07:20,623 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838233.f513ef78d5597df1e05f7b2f04bbef0d.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,623 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 16:07:20,623 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f513ef78d5597df1e05f7b2f04bbef0d/cf/4fa67ec143cc4a4abb73be4468ca0e78.660ec2e513f53b2a71948e5a44d6a6c6->hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/660ec2e513f53b2a71948e5a44d6a6c6/cf/4fa67ec143cc4a4abb73be4468ca0e78-top, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f513ef78d5597df1e05f7b2f04bbef0d/cf/9335497615ae4473a6d33207b6e71356.b72c1954ba520f9b50ef3138b4934a7c->hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b72c1954ba520f9b50ef3138b4934a7c/cf/9335497615ae4473a6d33207b6e71356-top] hfiles 2023-07-24 16:07:20,623 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f513ef78d5597df1e05f7b2f04bbef0d/cf/4fa67ec143cc4a4abb73be4468ca0e78.660ec2e513f53b2a71948e5a44d6a6c6 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,624 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f513ef78d5597df1e05f7b2f04bbef0d/cf/9335497615ae4473a6d33207b6e71356.b72c1954ba520f9b50ef3138b4934a7c for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,635 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838233.f513ef78d5597df1e05f7b2f04bbef0d. completed. 2023-07-24 16:07:20,635 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838233.f513ef78d5597df1e05f7b2f04bbef0d. 2023-07-24 16:07:20,635 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 16:07:20,635 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 16:07:20,636 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:20,636 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 16:07:20,636 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,33229,1690214755329' in zk 2023-07-24 16:07:20,642 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:20,642 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 16:07:20,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:20,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:20,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:20,642 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:20,642 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 16:07:20,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:20,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:20,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:20,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:20,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:20,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:20,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:20,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:20,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:20,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,33229,1690214755329': 2023-07-24 16:07:20,646 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33229,1690214755329' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-24 16:07:20,646 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-24 16:07:20,647 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 16:07:20,647 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 16:07:20,647 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,647 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 16:07:20,647 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:07:20,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 16:07:20,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-24 16:07:20,649 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 16:07:20,651 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,651 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:20,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,652 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,652 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:20,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,652 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,652 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:20,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,652 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:20,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:20,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:20,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:20,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:20,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:20,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:20,659 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:20,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:20,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:20,660 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:20,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,661 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:20,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:20,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:20,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:20,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:20,663 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:20,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:20,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,663 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:20,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:20,664 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:20,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:20,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:20,672 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:20,672 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:20,672 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,672 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:20,672 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:20,672 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,672 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:20,672 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,672 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:20,672 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:20,672 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:20,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:20,672 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:20,672 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:20,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:20,672 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,672 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:20,673 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,672 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:20,673 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:20,673 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,673 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:20,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:20,672 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:20,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:20,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:20,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:20,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:20,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:20,674 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:20,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:20,721 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,804 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-24 16:07:20,805 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,805 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,805 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1690214840544Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690214840673 (+129 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690214840673Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690214840681 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690214840707 (+26 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1690214840804 (+97 ms) 2023-07-24 16:07:20,808 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 16:07:20,810 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 261 msec 2023-07-24 16:07:20,849 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:07:20,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 16:07:20,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 16:07:20,851 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214840851 2023-07-24 16:07:20,852 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:32943, tgtDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214840851, rawTgtDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214840851, srcFsUri=hdfs://localhost:32943, srcDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0 2023-07-24 16:07:20,883 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:32943, inputRoot=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0 2023-07-24 16:07:20,883 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-371422625_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214840851, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214840851/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,883 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:32943, inputRoot=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0, snapshotDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-24 16:07:20,902 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214840851/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:20,954 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:20,955 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:20,956 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:20,956 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:22,006 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/hadoop-6375064000680458238.jar 2023-07-24 16:07:22,007 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:22,007 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:22,085 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/hadoop-8626418140607649294.jar 2023-07-24 16:07:22,086 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:22,086 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:22,087 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:22,087 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:22,087 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:22,088 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:22,088 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 16:07:22,088 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 16:07:22,089 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 16:07:22,089 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 16:07:22,089 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 16:07:22,090 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 16:07:22,090 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 16:07:22,091 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 16:07:22,091 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 16:07:22,092 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 16:07:22,092 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:07:22,092 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:07:22,093 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 16:07:22,093 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:07:22,094 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:07:22,094 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 16:07:22,095 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 16:07:23,078 WARN [Listener at jenkins-hbase4.apache.org/42941] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 16:07:23,081 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-24 16:07:23,083 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-24 16:07:23,165 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 16:07:23,165 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 16:07:23,315 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0005_000001 (auth:SIMPLE) 2023-07-24 16:07:25,188 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 16:07:29,886 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0005_000001 (auth:SIMPLE) 2023-07-24 16:07:32,237 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0005_000001 (auth:SIMPLE) 2023-07-24 16:07:36,184 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0005_000001 (auth:SIMPLE) 2023-07-24 16:07:37,355 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 16:07:37,359 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 16:07:37,369 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:37,370 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 16:07:37,370 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 16:07:37,371 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-526159531_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:37,371 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-24 16:07:37,371 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-24 16:07:37,371 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-526159531_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214840851/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214840851/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:37,372 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214840851/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-24 16:07:37,372 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214840851/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-24 16:07:37,379 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:37,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:37,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:37,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 16:07:37,384 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214857384"}]},"ts":"1690214857384"} 2023-07-24 16:07:37,386 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-24 16:07:37,387 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-24 16:07:37,388 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f513ef78d5597df1e05f7b2f04bbef0d, UNASSIGN}] 2023-07-24 16:07:37,391 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f513ef78d5597df1e05f7b2f04bbef0d, UNASSIGN 2023-07-24 16:07:37,392 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=f513ef78d5597df1e05f7b2f04bbef0d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:37,392 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838233.f513ef78d5597df1e05f7b2f04bbef0d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690214857392"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214857392"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214857392"}]},"ts":"1690214857392"} 2023-07-24 16:07:37,393 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure f513ef78d5597df1e05f7b2f04bbef0d, server=jenkins-hbase4.apache.org,33229,1690214755329}] 2023-07-24 16:07:37,485 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 16:07:37,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f513ef78d5597df1e05f7b2f04bbef0d 2023-07-24 16:07:37,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f513ef78d5597df1e05f7b2f04bbef0d, disabling compactions & flushes 2023-07-24 16:07:37,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838233.f513ef78d5597df1e05f7b2f04bbef0d. 2023-07-24 16:07:37,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838233.f513ef78d5597df1e05f7b2f04bbef0d. 2023-07-24 16:07:37,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838233.f513ef78d5597df1e05f7b2f04bbef0d. after waiting 0 ms 2023-07-24 16:07:37,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838233.f513ef78d5597df1e05f7b2f04bbef0d. 2023-07-24 16:07:37,556 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f513ef78d5597df1e05f7b2f04bbef0d/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-24 16:07:37,557 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:07:37,558 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838233.f513ef78d5597df1e05f7b2f04bbef0d. 2023-07-24 16:07:37,558 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f513ef78d5597df1e05f7b2f04bbef0d: 2023-07-24 16:07:37,560 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f513ef78d5597df1e05f7b2f04bbef0d 2023-07-24 16:07:37,561 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=f513ef78d5597df1e05f7b2f04bbef0d, regionState=CLOSED 2023-07-24 16:07:37,561 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838233.f513ef78d5597df1e05f7b2f04bbef0d.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690214857561"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214857561"}]},"ts":"1690214857561"} 2023-07-24 16:07:37,564 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-24 16:07:37,564 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure f513ef78d5597df1e05f7b2f04bbef0d, server=jenkins-hbase4.apache.org,33229,1690214755329 in 169 msec 2023-07-24 16:07:37,566 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-24 16:07:37,566 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=f513ef78d5597df1e05f7b2f04bbef0d, UNASSIGN in 176 msec 2023-07-24 16:07:37,567 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214857567"}]},"ts":"1690214857567"} 2023-07-24 16:07:37,568 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-24 16:07:37,570 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-24 16:07:37,573 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 191 msec 2023-07-24 16:07:37,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 16:07:37,687 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-24 16:07:37,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:37,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:37,691 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:37,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:37,692 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:37,693 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33229] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:37,696 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f513ef78d5597df1e05f7b2f04bbef0d 2023-07-24 16:07:37,696 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b72c1954ba520f9b50ef3138b4934a7c 2023-07-24 16:07:37,696 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/660ec2e513f53b2a71948e5a44d6a6c6 2023-07-24 16:07:37,698 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:37,698 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:37,698 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:37,698 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:37,698 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 16:07:37,698 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 16:07:37,698 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 16:07:37,700 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:37,700 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-24 16:07:37,700 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:37,700 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:37,700 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:37,700 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:37,700 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 16:07:37,701 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b72c1954ba520f9b50ef3138b4934a7c/cf, FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b72c1954ba520f9b50ef3138b4934a7c/recovered.edits] 2023-07-24 16:07:37,701 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 16:07:37,701 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:37,701 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:37,701 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 16:07:37,702 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 16:07:37,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-24 16:07:37,702 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 16:07:37,704 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f513ef78d5597df1e05f7b2f04bbef0d/cf, FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f513ef78d5597df1e05f7b2f04bbef0d/recovered.edits] 2023-07-24 16:07:37,704 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/660ec2e513f53b2a71948e5a44d6a6c6/cf, FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/660ec2e513f53b2a71948e5a44d6a6c6/recovered.edits] 2023-07-24 16:07:37,710 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f513ef78d5597df1e05f7b2f04bbef0d/cf/4fa67ec143cc4a4abb73be4468ca0e78.660ec2e513f53b2a71948e5a44d6a6c6 to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f513ef78d5597df1e05f7b2f04bbef0d/cf/4fa67ec143cc4a4abb73be4468ca0e78.660ec2e513f53b2a71948e5a44d6a6c6 2023-07-24 16:07:37,710 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b72c1954ba520f9b50ef3138b4934a7c/cf/9335497615ae4473a6d33207b6e71356 to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b72c1954ba520f9b50ef3138b4934a7c/cf/9335497615ae4473a6d33207b6e71356 2023-07-24 16:07:37,711 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/660ec2e513f53b2a71948e5a44d6a6c6/cf/4fa67ec143cc4a4abb73be4468ca0e78 to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/660ec2e513f53b2a71948e5a44d6a6c6/cf/4fa67ec143cc4a4abb73be4468ca0e78 2023-07-24 16:07:37,713 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f513ef78d5597df1e05f7b2f04bbef0d/cf/9335497615ae4473a6d33207b6e71356.b72c1954ba520f9b50ef3138b4934a7c to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f513ef78d5597df1e05f7b2f04bbef0d/cf/9335497615ae4473a6d33207b6e71356.b72c1954ba520f9b50ef3138b4934a7c 2023-07-24 16:07:37,717 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/660ec2e513f53b2a71948e5a44d6a6c6/recovered.edits/8.seqid to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/660ec2e513f53b2a71948e5a44d6a6c6/recovered.edits/8.seqid 2023-07-24 16:07:37,717 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b72c1954ba520f9b50ef3138b4934a7c/recovered.edits/8.seqid to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b72c1954ba520f9b50ef3138b4934a7c/recovered.edits/8.seqid 2023-07-24 16:07:37,717 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/660ec2e513f53b2a71948e5a44d6a6c6 2023-07-24 16:07:37,717 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b72c1954ba520f9b50ef3138b4934a7c 2023-07-24 16:07:37,718 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f513ef78d5597df1e05f7b2f04bbef0d/recovered.edits/12.seqid to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f513ef78d5597df1e05f7b2f04bbef0d/recovered.edits/12.seqid 2023-07-24 16:07:37,719 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/f513ef78d5597df1e05f7b2f04bbef0d 2023-07-24 16:07:37,719 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-24 16:07:37,721 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:37,724 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-24 16:07:37,726 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-24 16:07:37,728 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:37,728 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-24 16:07:37,728 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838233.f513ef78d5597df1e05f7b2f04bbef0d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690214857728"}]},"ts":"9223372036854775807"} 2023-07-24 16:07:37,731 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-24 16:07:37,731 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f513ef78d5597df1e05f7b2f04bbef0d, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690214838233.f513ef78d5597df1e05f7b2f04bbef0d.', STARTKEY => '', ENDKEY => ''}] 2023-07-24 16:07:37,731 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-24 16:07:37,731 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690214857731"}]},"ts":"9223372036854775807"} 2023-07-24 16:07:37,753 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-24 16:07:37,757 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:37,764 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 70 msec 2023-07-24 16:07:37,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-24 16:07:37,804 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-24 16:07:37,804 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:37,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:37,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:37,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 16:07:37,810 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214857810"}]},"ts":"1690214857810"} 2023-07-24 16:07:37,813 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-24 16:07:37,815 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-24 16:07:37,815 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2716c94bbe510883ffbf1d5f775097f1, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=db873e25934e7aeaaf59bd533066d312, UNASSIGN}] 2023-07-24 16:07:37,818 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2716c94bbe510883ffbf1d5f775097f1, UNASSIGN 2023-07-24 16:07:37,824 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=2716c94bbe510883ffbf1d5f775097f1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:37,825 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690214857824"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214857824"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214857824"}]},"ts":"1690214857824"} 2023-07-24 16:07:37,826 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 2716c94bbe510883ffbf1d5f775097f1, server=jenkins-hbase4.apache.org,33229,1690214755329}] 2023-07-24 16:07:37,826 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=db873e25934e7aeaaf59bd533066d312, UNASSIGN 2023-07-24 16:07:37,828 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=db873e25934e7aeaaf59bd533066d312, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:37,828 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690214857828"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214857828"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214857828"}]},"ts":"1690214857828"} 2023-07-24 16:07:37,830 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure db873e25934e7aeaaf59bd533066d312, server=jenkins-hbase4.apache.org,38047,1690214755282}] 2023-07-24 16:07:37,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 16:07:37,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2716c94bbe510883ffbf1d5f775097f1 2023-07-24 16:07:37,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2716c94bbe510883ffbf1d5f775097f1, disabling compactions & flushes 2023-07-24 16:07:37,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1. 2023-07-24 16:07:37,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1. 2023-07-24 16:07:37,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1. after waiting 0 ms 2023-07-24 16:07:37,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1. 2023-07-24 16:07:37,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close db873e25934e7aeaaf59bd533066d312 2023-07-24 16:07:37,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing db873e25934e7aeaaf59bd533066d312, disabling compactions & flushes 2023-07-24 16:07:37,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312. 2023-07-24 16:07:37,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312. 2023-07-24 16:07:37,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312. after waiting 0 ms 2023-07-24 16:07:37,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312. 2023-07-24 16:07:37,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion/2716c94bbe510883ffbf1d5f775097f1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 16:07:38,000 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:07:38,001 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1. 2023-07-24 16:07:38,001 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2716c94bbe510883ffbf1d5f775097f1: 2023-07-24 16:07:38,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithMergeRegion/db873e25934e7aeaaf59bd533066d312/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 16:07:38,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:07:38,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312. 2023-07-24 16:07:38,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for db873e25934e7aeaaf59bd533066d312: 2023-07-24 16:07:38,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2716c94bbe510883ffbf1d5f775097f1 2023-07-24 16:07:38,004 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=2716c94bbe510883ffbf1d5f775097f1, regionState=CLOSED 2023-07-24 16:07:38,005 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690214858004"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214858004"}]},"ts":"1690214858004"} 2023-07-24 16:07:38,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed db873e25934e7aeaaf59bd533066d312 2023-07-24 16:07:38,007 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=db873e25934e7aeaaf59bd533066d312, regionState=CLOSED 2023-07-24 16:07:38,007 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690214858007"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214858007"}]},"ts":"1690214858007"} 2023-07-24 16:07:38,014 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-24 16:07:38,015 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 2716c94bbe510883ffbf1d5f775097f1, server=jenkins-hbase4.apache.org,33229,1690214755329 in 182 msec 2023-07-24 16:07:38,015 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-24 16:07:38,015 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure db873e25934e7aeaaf59bd533066d312, server=jenkins-hbase4.apache.org,38047,1690214755282 in 179 msec 2023-07-24 16:07:38,016 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2716c94bbe510883ffbf1d5f775097f1, UNASSIGN in 200 msec 2023-07-24 16:07:38,017 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-24 16:07:38,017 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=db873e25934e7aeaaf59bd533066d312, UNASSIGN in 200 msec 2023-07-24 16:07:38,018 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214858018"}]},"ts":"1690214858018"} 2023-07-24 16:07:38,020 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-24 16:07:38,021 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-24 16:07:38,023 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 217 msec 2023-07-24 16:07:38,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 16:07:38,112 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-24 16:07:38,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:38,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:38,116 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:38,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:38,117 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:38,118 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33229] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:38,121 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:38,121 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:38,121 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:38,122 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 16:07:38,122 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 16:07:38,122 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 16:07:38,123 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:38,123 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:38,123 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:38,123 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:38,123 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:38,123 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:38,123 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:38,123 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:38,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-24 16:07:38,124 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-24 16:07:38,124 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 16:07:38,124 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2716c94bbe510883ffbf1d5f775097f1 2023-07-24 16:07:38,124 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/db873e25934e7aeaaf59bd533066d312 2023-07-24 16:07:38,127 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2716c94bbe510883ffbf1d5f775097f1/cf, FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2716c94bbe510883ffbf1d5f775097f1/recovered.edits] 2023-07-24 16:07:38,127 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/db873e25934e7aeaaf59bd533066d312/cf, FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/db873e25934e7aeaaf59bd533066d312/recovered.edits] 2023-07-24 16:07:38,147 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2716c94bbe510883ffbf1d5f775097f1/cf/4eaf3dab51ca42c3bf9085b59ef3d517 to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/2716c94bbe510883ffbf1d5f775097f1/cf/4eaf3dab51ca42c3bf9085b59ef3d517 2023-07-24 16:07:38,147 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/db873e25934e7aeaaf59bd533066d312/cf/28843d092fd646c8a96a0b8e56deb1c8 to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/db873e25934e7aeaaf59bd533066d312/cf/28843d092fd646c8a96a0b8e56deb1c8 2023-07-24 16:07:38,151 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2716c94bbe510883ffbf1d5f775097f1/recovered.edits/9.seqid to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/2716c94bbe510883ffbf1d5f775097f1/recovered.edits/9.seqid 2023-07-24 16:07:38,154 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2716c94bbe510883ffbf1d5f775097f1 2023-07-24 16:07:38,155 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/db873e25934e7aeaaf59bd533066d312/recovered.edits/9.seqid to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/db873e25934e7aeaaf59bd533066d312/recovered.edits/9.seqid 2023-07-24 16:07:38,156 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/db873e25934e7aeaaf59bd533066d312 2023-07-24 16:07:38,156 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-24 16:07:38,158 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-24 16:07:38,158 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-24 16:07:38,165 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230724e6ac502e612546828d6874e37ba2557f to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230724e6ac502e612546828d6874e37ba2557f 2023-07-24 16:07:38,169 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230724267d3f65ce464ed08eb7f98f251ff67c to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230724267d3f65ce464ed08eb7f98f251ff67c 2023-07-24 16:07:38,169 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-24 16:07:38,172 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:38,205 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-24 16:07:38,213 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-24 16:07:38,214 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:38,214 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-24 16:07:38,215 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690214858215"}]},"ts":"9223372036854775807"} 2023-07-24 16:07:38,215 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690214858215"}]},"ts":"9223372036854775807"} 2023-07-24 16:07:38,216 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 16:07:38,216 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2716c94bbe510883ffbf1d5f775097f1, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690214834653.2716c94bbe510883ffbf1d5f775097f1.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => db873e25934e7aeaaf59bd533066d312, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690214834653.db873e25934e7aeaaf59bd533066d312.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 16:07:38,216 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-24 16:07:38,217 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690214858216"}]},"ts":"9223372036854775807"} 2023-07-24 16:07:38,218 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-24 16:07:38,220 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:38,221 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 108 msec 2023-07-24 16:07:38,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-24 16:07:38,225 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-24 16:07:38,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-24 16:07:38,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:38,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-24 16:07:38,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 16:07:38,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-24 16:07:38,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 16:07:38,304 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=756 (was 746) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-526159531_17 at /127.0.0.1:53796 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x26dbae7d-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_609223580_1 at /127.0.0.1:35588 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x26dbae7d-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x26dbae7d-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3985 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:38755 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-526159531_17 at /127.0.0.1:35594 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x26dbae7d-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-526159531_17 at /127.0.0.1:37798 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x26dbae7d-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x26dbae7d-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_609223580_1 at /127.0.0.1:37760 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=899 (was 893) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=623 (was 459) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 184), AvailableMemoryMB=5583 (was 6168) 2023-07-24 16:07:38,304 WARN [Listener at jenkins-hbase4.apache.org/42941] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-24 16:07:38,332 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=756, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=623, ProcessCount=184, AvailableMemoryMB=5581 2023-07-24 16:07:38,332 WARN [Listener at jenkins-hbase4.apache.org/42941] hbase.ResourceChecker(130): Thread=756 is superior to 500 2023-07-24 16:07:38,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 16:07:38,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 16:07:38,341 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 16:07:38,342 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 16:07:38,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-24 16:07:38,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 16:07:38,345 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7941403c7fa46670b43414407571c4c0 2023-07-24 16:07:38,345 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe44aafe912136bfe432372d3c642bc3 2023-07-24 16:07:38,346 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7941403c7fa46670b43414407571c4c0 empty. 2023-07-24 16:07:38,346 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe44aafe912136bfe432372d3c642bc3 empty. 2023-07-24 16:07:38,351 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7941403c7fa46670b43414407571c4c0 2023-07-24 16:07:38,352 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe44aafe912136bfe432372d3c642bc3 2023-07-24 16:07:38,352 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-24 16:07:38,413 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-24 16:07:38,415 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7941403c7fa46670b43414407571c4c0, NAME => 'testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp 2023-07-24 16:07:38,416 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => fe44aafe912136bfe432372d3c642bc3, NAME => 'testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp 2023-07-24 16:07:38,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 16:07:38,486 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:07:38,486 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:07:38,486 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 7941403c7fa46670b43414407571c4c0, disabling compactions & flushes 2023-07-24 16:07:38,486 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0. 2023-07-24 16:07:38,486 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0. 2023-07-24 16:07:38,486 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0. after waiting 0 ms 2023-07-24 16:07:38,487 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0. 2023-07-24 16:07:38,487 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0. 2023-07-24 16:07:38,487 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 7941403c7fa46670b43414407571c4c0: 2023-07-24 16:07:38,486 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing fe44aafe912136bfe432372d3c642bc3, disabling compactions & flushes 2023-07-24 16:07:38,488 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3. 2023-07-24 16:07:38,488 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3. 2023-07-24 16:07:38,488 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3. after waiting 0 ms 2023-07-24 16:07:38,488 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3. 2023-07-24 16:07:38,488 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3. 2023-07-24 16:07:38,488 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for fe44aafe912136bfe432372d3c642bc3: 2023-07-24 16:07:38,491 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 16:07:38,492 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690214858492"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214858492"}]},"ts":"1690214858492"} 2023-07-24 16:07:38,492 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690214858492"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214858492"}]},"ts":"1690214858492"} 2023-07-24 16:07:38,495 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 16:07:38,496 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 16:07:38,497 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214858496"}]},"ts":"1690214858496"} 2023-07-24 16:07:38,500 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-24 16:07:38,516 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 16:07:38,517 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 16:07:38,518 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 16:07:38,518 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 16:07:38,518 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 16:07:38,518 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7941403c7fa46670b43414407571c4c0, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fe44aafe912136bfe432372d3c642bc3, ASSIGN}] 2023-07-24 16:07:38,521 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7941403c7fa46670b43414407571c4c0, ASSIGN 2023-07-24 16:07:38,521 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fe44aafe912136bfe432372d3c642bc3, ASSIGN 2023-07-24 16:07:38,526 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fe44aafe912136bfe432372d3c642bc3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33229,1690214755329; forceNewPlan=false, retain=false 2023-07-24 16:07:38,526 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7941403c7fa46670b43414407571c4c0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33053,1690214755222; forceNewPlan=false, retain=false 2023-07-24 16:07:38,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 16:07:38,676 INFO [jenkins-hbase4:43489] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 16:07:38,679 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=fe44aafe912136bfe432372d3c642bc3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:38,679 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=7941403c7fa46670b43414407571c4c0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:38,679 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690214858679"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214858679"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214858679"}]},"ts":"1690214858679"} 2023-07-24 16:07:38,680 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690214858679"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214858679"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214858679"}]},"ts":"1690214858679"} 2023-07-24 16:07:38,682 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure fe44aafe912136bfe432372d3c642bc3, server=jenkins-hbase4.apache.org,33229,1690214755329}] 2023-07-24 16:07:38,683 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 7941403c7fa46670b43414407571c4c0, server=jenkins-hbase4.apache.org,33053,1690214755222}] 2023-07-24 16:07:38,840 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3. 2023-07-24 16:07:38,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fe44aafe912136bfe432372d3c642bc3, NAME => 'testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 16:07:38,840 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3. service=AccessControlService 2023-07-24 16:07:38,841 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 16:07:38,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState fe44aafe912136bfe432372d3c642bc3 2023-07-24 16:07:38,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:07:38,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fe44aafe912136bfe432372d3c642bc3 2023-07-24 16:07:38,841 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fe44aafe912136bfe432372d3c642bc3 2023-07-24 16:07:38,845 INFO [StoreOpener-fe44aafe912136bfe432372d3c642bc3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fe44aafe912136bfe432372d3c642bc3 2023-07-24 16:07:38,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0. 2023-07-24 16:07:38,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7941403c7fa46670b43414407571c4c0, NAME => 'testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 16:07:38,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0. service=AccessControlService 2023-07-24 16:07:38,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 16:07:38,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 7941403c7fa46670b43414407571c4c0 2023-07-24 16:07:38,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:07:38,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7941403c7fa46670b43414407571c4c0 2023-07-24 16:07:38,849 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7941403c7fa46670b43414407571c4c0 2023-07-24 16:07:38,851 INFO [StoreOpener-7941403c7fa46670b43414407571c4c0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7941403c7fa46670b43414407571c4c0 2023-07-24 16:07:38,852 DEBUG [StoreOpener-fe44aafe912136bfe432372d3c642bc3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testEmptyExportFileSystemState/fe44aafe912136bfe432372d3c642bc3/cf 2023-07-24 16:07:38,852 DEBUG [StoreOpener-fe44aafe912136bfe432372d3c642bc3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testEmptyExportFileSystemState/fe44aafe912136bfe432372d3c642bc3/cf 2023-07-24 16:07:38,852 INFO [StoreOpener-fe44aafe912136bfe432372d3c642bc3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fe44aafe912136bfe432372d3c642bc3 columnFamilyName cf 2023-07-24 16:07:38,853 DEBUG [StoreOpener-7941403c7fa46670b43414407571c4c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testEmptyExportFileSystemState/7941403c7fa46670b43414407571c4c0/cf 2023-07-24 16:07:38,853 DEBUG [StoreOpener-7941403c7fa46670b43414407571c4c0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testEmptyExportFileSystemState/7941403c7fa46670b43414407571c4c0/cf 2023-07-24 16:07:38,853 INFO [StoreOpener-7941403c7fa46670b43414407571c4c0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7941403c7fa46670b43414407571c4c0 columnFamilyName cf 2023-07-24 16:07:38,853 INFO [StoreOpener-fe44aafe912136bfe432372d3c642bc3-1] regionserver.HStore(310): Store=fe44aafe912136bfe432372d3c642bc3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 16:07:38,854 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testEmptyExportFileSystemState/fe44aafe912136bfe432372d3c642bc3 2023-07-24 16:07:38,855 INFO [StoreOpener-7941403c7fa46670b43414407571c4c0-1] regionserver.HStore(310): Store=7941403c7fa46670b43414407571c4c0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 16:07:38,855 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testEmptyExportFileSystemState/fe44aafe912136bfe432372d3c642bc3 2023-07-24 16:07:38,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testEmptyExportFileSystemState/7941403c7fa46670b43414407571c4c0 2023-07-24 16:07:38,856 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testEmptyExportFileSystemState/7941403c7fa46670b43414407571c4c0 2023-07-24 16:07:38,858 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fe44aafe912136bfe432372d3c642bc3 2023-07-24 16:07:38,860 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7941403c7fa46670b43414407571c4c0 2023-07-24 16:07:38,862 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testEmptyExportFileSystemState/fe44aafe912136bfe432372d3c642bc3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 16:07:38,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testEmptyExportFileSystemState/7941403c7fa46670b43414407571c4c0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 16:07:38,863 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fe44aafe912136bfe432372d3c642bc3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69704696, jitterRate=0.03868091106414795}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 16:07:38,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fe44aafe912136bfe432372d3c642bc3: 2023-07-24 16:07:38,864 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7941403c7fa46670b43414407571c4c0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59476318, jitterRate=-0.11373379826545715}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 16:07:38,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7941403c7fa46670b43414407571c4c0: 2023-07-24 16:07:38,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3., pid=93, masterSystemTime=1690214858836 2023-07-24 16:07:38,865 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0., pid=94, masterSystemTime=1690214858837 2023-07-24 16:07:38,867 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3. 2023-07-24 16:07:38,867 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3. 2023-07-24 16:07:38,868 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=fe44aafe912136bfe432372d3c642bc3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:38,868 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690214858868"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690214858868"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690214858868"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690214858868"}]},"ts":"1690214858868"} 2023-07-24 16:07:38,868 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0. 2023-07-24 16:07:38,868 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0. 2023-07-24 16:07:38,869 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=7941403c7fa46670b43414407571c4c0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:38,869 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690214858869"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690214858869"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690214858869"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690214858869"}]},"ts":"1690214858869"} 2023-07-24 16:07:38,872 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-24 16:07:38,872 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure fe44aafe912136bfe432372d3c642bc3, server=jenkins-hbase4.apache.org,33229,1690214755329 in 188 msec 2023-07-24 16:07:38,873 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-24 16:07:38,873 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fe44aafe912136bfe432372d3c642bc3, ASSIGN in 354 msec 2023-07-24 16:07:38,873 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 7941403c7fa46670b43414407571c4c0, server=jenkins-hbase4.apache.org,33053,1690214755222 in 188 msec 2023-07-24 16:07:38,876 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-24 16:07:38,876 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7941403c7fa46670b43414407571c4c0, ASSIGN in 355 msec 2023-07-24 16:07:38,876 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 16:07:38,877 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214858876"}]},"ts":"1690214858876"} 2023-07-24 16:07:38,878 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-24 16:07:38,881 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 16:07:38,881 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-24 16:07:38,883 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33229] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 16:07:38,884 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:38,884 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:38,884 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:38,886 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:38,886 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 16:07:38,886 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 16:07:38,887 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 16:07:38,887 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 16:07:38,890 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 550 msec 2023-07-24 16:07:38,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 16:07:38,950 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-24 16:07:38,952 DEBUG [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-24 16:07:38,952 DEBUG [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0. 2023-07-24 16:07:38,964 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 16:07:39,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 16:07:39,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690214859022 (current time:1690214859022). 2023-07-24 16:07:39,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 16:07:39,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(139): Connect 0x1e6f1be0 to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:07:39,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5440111f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:07:39,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:07:39,060 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38376, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:07:39,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1e6f1be0 to 127.0.0.1:49766 2023-07-24 16:07:39,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:07:39,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(139): Connect 0x685f2df6 to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:07:39,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@e099b06, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:07:39,103 DEBUG [hconnection-0x5a15bb31-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:07:39,107 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:07:39,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x685f2df6 to 127.0.0.1:49766 2023-07-24 16:07:39,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:07:39,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 16:07:39,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 16:07:39,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 16:07:39,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 16:07:39,124 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 16:07:39,124 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690215459124 2023-07-24 16:07:39,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 16:07:39,125 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-24 16:07:39,127 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 16:07:39,128 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 16:07:39,128 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 16:07:39,128 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 16:07:39,129 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-24 16:07:39,134 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 16:07:39,135 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690215459135 2023-07-24 16:07:39,173 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,173 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-24 16:07:39,173 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:39,174 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-24 16:07:39,175 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-24 16:07:39,175 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,175 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,179 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:39,179 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:39,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:39,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:39,179 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:39,179 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:39,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:39,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:39,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:39,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:39,179 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:39,180 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:39,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,180 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:39,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,180 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 16:07:39,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 16:07:39,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 16:07:39,181 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 16:07:39,181 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,181 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 16:07:39,181 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:39,182 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 16:07:39,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,184 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 16:07:39,184 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 16:07:39,184 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,184 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 16:07:39,184 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:39,186 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,188 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 16:07:39,188 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 16:07:39,188 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:39,188 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 16:07:39,189 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 16:07:39,189 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33229,1690214755329' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 16:07:39,189 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 16:07:39,189 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 16:07:39,189 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33053,1690214755222' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 16:07:39,188 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 16:07:39,189 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38047,1690214755282' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 16:07:39,192 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,194 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:39,194 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,194 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,195 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:07:39,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:39,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:39,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:39,195 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,195 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:07:39,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:39,197 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:39,197 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,199 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,199 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:07:39,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:39,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:39,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:39,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:39,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:39,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33229,1690214755329' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 16:07:39,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5082bd9f[Count = 1] remaining members to acquire global barrier 2023-07-24 16:07:39,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:39,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:39,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:39,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:39,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:39,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:39,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:39,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:39,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:39,206 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33053,1690214755222' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 16:07:39,206 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5082bd9f[Count = 0] remaining members to acquire global barrier 2023-07-24 16:07:39,206 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 16:07:39,206 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,208 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,208 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,209 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 16:07:39,209 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 16:07:39,209 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 16:07:39,209 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38047,1690214755282' in zk 2023-07-24 16:07:39,209 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:39,210 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:39,210 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 16:07:39,211 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 16:07:39,211 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:39,211 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 16:07:39,214 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,215 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 16:07:39,215 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 16:07:39,215 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 16:07:39,217 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0. 2023-07-24 16:07:39,217 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0. started... 2023-07-24 16:07:39,217 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7941403c7fa46670b43414407571c4c0: 2023-07-24 16:07:39,217 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,218 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 16:07:39,218 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 16:07:39,222 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 16:07:39,222 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 16:07:39,222 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3. 2023-07-24 16:07:39,222 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3. started... 2023-07-24 16:07:39,225 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fe44aafe912136bfe432372d3c642bc3: 2023-07-24 16:07:39,225 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,225 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 16:07:39,225 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 16:07:39,228 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:07:39,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 16:07:39,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 16:07:39,230 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 16:07:39,430 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:07:39,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 16:07:39,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 16:07:39,432 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 16:07:39,689 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3. completed. 2023-07-24 16:07:39,689 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3. 2023-07-24 16:07:39,689 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0. completed. 2023-07-24 16:07:39,689 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0. 2023-07-24 16:07:39,689 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 16:07:39,689 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 16:07:39,689 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:39,689 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 16:07:39,689 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33229,1690214755329' in zk 2023-07-24 16:07:39,689 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 16:07:39,689 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 16:07:39,689 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:39,690 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 16:07:39,690 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33053,1690214755222' in zk 2023-07-24 16:07:39,693 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:39,693 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 16:07:39,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:39,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:39,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:39,693 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:39,693 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 16:07:39,693 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:39,693 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:39,693 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 16:07:39,695 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 16:07:39,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:39,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:39,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:39,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:39,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:39,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:39,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:39,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:39,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:39,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33053,1690214755222': 2023-07-24 16:07:39,701 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33053,1690214755222' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 16:07:39,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:39,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:39,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:39,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:39,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:39,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:39,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:39,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:39,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:39,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:39,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:39,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:39,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33229,1690214755329': 2023-07-24 16:07:39,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33229,1690214755329' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 16:07:39,706 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-24 16:07:39,706 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 16:07:39,706 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 16:07:39,706 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,707 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 16:07:39,709 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,709 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:39,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:39,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:39,709 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:39,709 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,709 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:39,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,710 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:39,709 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:39,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:39,710 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:39,710 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:39,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:39,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:39,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:39,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:39,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:39,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,711 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:39,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:39,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:39,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:39,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:39,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,713 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:39,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:39,714 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:39,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:39,715 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:39,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:39,720 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:39,721 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:39,721 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:39,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:39,721 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:39,721 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:39,723 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:39,723 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:39,723 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,723 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:39,723 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,723 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:39,723 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:39,723 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,723 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,721 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:39,723 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:39,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:39,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:39,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:39,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:39,721 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:39,721 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:39,721 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,725 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-24 16:07:39,725 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,725 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 16:07:39,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 16:07:39,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:39,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:39,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:39,728 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:39,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:39,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:39,732 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:07:39,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 16:07:39,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 16:07:39,733 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 16:07:39,750 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,751 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,753 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-24 16:07:39,815 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,868 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-24 16:07:39,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,868 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:39,868 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690214859125Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1690214859750 (+625 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690214859750Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1690214859751 (+1 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1690214859772 (+21 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690214859807 (+35 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690214859868 (+61 ms) 2023-07-24 16:07:39,873 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 16:07:39,874 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 747 msec 2023-07-24 16:07:40,234 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:07:40,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 16:07:40,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 16:07:40,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33053] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 16:07:40,240 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33229] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 16:07:40,245 DEBUG [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-24 16:07:40,245 DEBUG [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0. 2023-07-24 16:07:40,246 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 16:07:40,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 16:07:40,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690214860257 (current time:1690214860257). 2023-07-24 16:07:40,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 16:07:40,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(139): Connect 0x287b4bbd to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:07:40,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5fc0b1b0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:07:40,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:07:40,276 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38396, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:07:40,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x287b4bbd to 127.0.0.1:49766 2023-07-24 16:07:40,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:07:40,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(139): Connect 0x43edb471 to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:07:40,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31393912, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:07:40,293 DEBUG [hconnection-0x6b2e53b4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:07:40,296 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38400, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:07:40,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43edb471 to 127.0.0.1:49766 2023-07-24 16:07:40,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:07:40,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 16:07:40,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 16:07:40,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 16:07:40,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 16:07:40,306 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 16:07:40,306 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690215460306 2023-07-24 16:07:40,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 16:07:40,307 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-24 16:07:40,308 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 16:07:40,308 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 16:07:40,309 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 16:07:40,309 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 16:07:40,310 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-07-24 16:07:40,311 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 16:07:40,311 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690215460311 2023-07-24 16:07:40,330 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,330 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-24 16:07:40,330 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:40,332 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-24 16:07:40,332 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-24 16:07:40,333 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,333 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,334 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:40,334 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:40,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:40,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:40,334 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:40,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:40,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:40,335 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:40,335 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:40,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,335 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:40,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:40,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:40,335 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:40,335 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 16:07:40,335 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,336 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 16:07:40,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 16:07:40,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,336 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,336 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 16:07:40,336 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 16:07:40,336 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,337 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 16:07:40,337 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:40,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 16:07:40,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,337 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 16:07:40,338 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,342 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,340 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 16:07:40,343 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 16:07:40,343 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33229,1690214755329' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 16:07:40,343 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 16:07:40,343 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:40,343 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 16:07:40,344 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 16:07:40,345 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 16:07:40,345 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:40,345 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33053,1690214755222' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 16:07:40,350 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 16:07:40,350 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 16:07:40,350 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38047,1690214755282' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 16:07:40,352 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:40,352 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:40,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:40,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:40,353 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:40,353 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,353 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:07:40,353 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,353 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:40,354 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:40,354 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:07:40,354 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,354 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:07:40,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:40,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:40,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:40,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:40,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33229,1690214755329' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 16:07:40,356 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d6b71e7[Count = 1] remaining members to acquire global barrier 2023-07-24 16:07:40,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:40,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:40,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:40,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:40,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:40,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:40,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:40,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:40,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:40,358 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33053,1690214755222' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 16:07:40,359 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d6b71e7[Count = 0] remaining members to acquire global barrier 2023-07-24 16:07:40,359 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 16:07:40,359 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,365 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,365 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,365 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,365 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 16:07:40,365 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:40,365 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 16:07:40,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,365 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 16:07:40,365 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 16:07:40,366 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:40,366 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 16:07:40,366 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,38047,1690214755282' in zk 2023-07-24 16:07:40,367 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 16:07:40,368 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:40,368 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 16:07:40,370 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 16:07:40,372 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3. 2023-07-24 16:07:40,373 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0. 2023-07-24 16:07:40,373 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3. started... 2023-07-24 16:07:40,372 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 16:07:40,372 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 16:07:40,373 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 16:07:40,373 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0. started... 2023-07-24 16:07:40,373 INFO [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fe44aafe912136bfe432372d3c642bc3 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-24 16:07:40,373 INFO [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7941403c7fa46670b43414407571c4c0 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-24 16:07:40,403 INFO [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023072475ab052642774a6d8fe97792b0c3a62a to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023072475ab052642774a6d8fe97792b0c3a62a 2023-07-24 16:07:40,408 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:07:40,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 16:07:40,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 16:07:40,410 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 16:07:40,411 INFO [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230724dd9150f3762244d18838ae4bd997e677 to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230724dd9150f3762244d18838ae4bd997e677 2023-07-24 16:07:40,427 INFO [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testEmptyExportFileSystemState/7941403c7fa46670b43414407571c4c0/.tmp/cf/926c956e69de4c4db69d33a12826a209 2023-07-24 16:07:40,433 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testEmptyExportFileSystemState/7941403c7fa46670b43414407571c4c0/.tmp/cf/926c956e69de4c4db69d33a12826a209 as hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testEmptyExportFileSystemState/7941403c7fa46670b43414407571c4c0/cf/926c956e69de4c4db69d33a12826a209 2023-07-24 16:07:40,435 INFO [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testEmptyExportFileSystemState/fe44aafe912136bfe432372d3c642bc3/.tmp/cf/fa7dfdc33c034246bb21ce0bac1c4136 2023-07-24 16:07:40,438 INFO [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testEmptyExportFileSystemState/7941403c7fa46670b43414407571c4c0/cf/926c956e69de4c4db69d33a12826a209, entries=3, sequenceid=6, filesize=5.4 K 2023-07-24 16:07:40,440 INFO [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 7941403c7fa46670b43414407571c4c0 in 67ms, sequenceid=6, compaction requested=false 2023-07-24 16:07:40,442 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7941403c7fa46670b43414407571c4c0: 2023-07-24 16:07:40,442 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,442 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 16:07:40,442 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testEmptyExportFileSystemState/7941403c7fa46670b43414407571c4c0/cf/926c956e69de4c4db69d33a12826a209] hfiles 2023-07-24 16:07:40,442 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testEmptyExportFileSystemState/7941403c7fa46670b43414407571c4c0/cf/926c956e69de4c4db69d33a12826a209 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,444 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testEmptyExportFileSystemState/fe44aafe912136bfe432372d3c642bc3/.tmp/cf/fa7dfdc33c034246bb21ce0bac1c4136 as hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testEmptyExportFileSystemState/fe44aafe912136bfe432372d3c642bc3/cf/fa7dfdc33c034246bb21ce0bac1c4136 2023-07-24 16:07:40,453 INFO [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testEmptyExportFileSystemState/fe44aafe912136bfe432372d3c642bc3/cf/fa7dfdc33c034246bb21ce0bac1c4136, entries=47, sequenceid=6, filesize=13.1 K 2023-07-24 16:07:40,454 INFO [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for fe44aafe912136bfe432372d3c642bc3 in 81ms, sequenceid=6, compaction requested=false 2023-07-24 16:07:40,454 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fe44aafe912136bfe432372d3c642bc3: 2023-07-24 16:07:40,454 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,454 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 16:07:40,454 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testEmptyExportFileSystemState/fe44aafe912136bfe432372d3c642bc3/cf/fa7dfdc33c034246bb21ce0bac1c4136] hfiles 2023-07-24 16:07:40,454 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testEmptyExportFileSystemState/fe44aafe912136bfe432372d3c642bc3/cf/fa7dfdc33c034246bb21ce0bac1c4136 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,467 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0. completed. 2023-07-24 16:07:40,467 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0. 2023-07-24 16:07:40,467 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 16:07:40,467 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 16:07:40,467 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:40,467 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 16:07:40,467 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33053,1690214755222' in zk 2023-07-24 16:07:40,469 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:40,469 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 16:07:40,469 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:40,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:40,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:40,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:40,469 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 16:07:40,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:40,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:40,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:40,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:40,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:40,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:40,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:40,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:40,483 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3. completed. 2023-07-24 16:07:40,483 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3. 2023-07-24 16:07:40,484 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 16:07:40,484 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 16:07:40,484 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:40,484 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 16:07:40,484 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33229,1690214755329' in zk 2023-07-24 16:07:40,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33053,1690214755222': 2023-07-24 16:07:40,484 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33053,1690214755222' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 16:07:40,487 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 16:07:40,487 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:40,487 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:40,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:40,487 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 16:07:40,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:40,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:40,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:40,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:40,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:40,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:40,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:40,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:40,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:40,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:40,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:40,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,33229,1690214755329': 2023-07-24 16:07:40,493 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33229,1690214755329' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 16:07:40,493 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-24 16:07:40,494 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 16:07:40,494 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 16:07:40,494 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,494 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 16:07:40,495 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,495 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,496 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,496 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:40,495 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:40,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:40,495 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,495 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:40,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,496 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:40,496 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:40,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:40,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:40,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:40,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:40,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:40,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:40,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:40,497 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:40,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,497 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:40,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:40,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:40,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:40,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:40,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:40,499 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:40,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,499 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:40,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:40,500 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:40,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:40,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:40,502 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:40,502 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:40,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:40,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:40,502 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:40,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:40,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:40,503 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:40,503 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:40,503 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:40,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:40,503 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:40,503 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:40,503 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:40,503 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:40,505 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-24 16:07:40,503 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:40,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,505 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:40,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 16:07:40,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:40,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:40,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:40,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:40,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:40,505 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,505 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:40,505 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,505 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:40,506 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:40,506 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,506 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230724dd9150f3762244d18838ae4bd997e677, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023072475ab052642774a6d8fe97792b0c3a62a] mob files 2023-07-24 16:07:40,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230724dd9150f3762244d18838ae4bd997e677 2023-07-24 16:07:40,506 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023072475ab052642774a6d8fe97792b0c3a62a 2023-07-24 16:07:40,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,547 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,582 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-24 16:07:40,582 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,583 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,583 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690214860307Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1690214860520 (+213 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1690214860520Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1690214860520Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1690214860526 (+6 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1690214860540 (+14 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690214860582 (+42 ms) 2023-07-24 16:07:40,586 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 16:07:40,589 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 278 msec 2023-07-24 16:07:40,610 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:07:40,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 16:07:40,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 16:07:40,612 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214860612 2023-07-24 16:07:40,612 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:32943, tgtDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214860612, rawTgtDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214860612, srcFsUri=hdfs://localhost:32943, srcDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0 2023-07-24 16:07:40,642 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:32943, inputRoot=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0 2023-07-24 16:07:40,642 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1520968759_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214860612, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214860612/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,642 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:32943, inputRoot=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0, snapshotDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-24 16:07:40,648 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214860612/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:40,691 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:40,691 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:40,692 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:40,692 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:41,796 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/hadoop-4001733284417522151.jar 2023-07-24 16:07:41,797 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:41,797 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:41,884 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/hadoop-8464024354105003488.jar 2023-07-24 16:07:41,885 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:41,885 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:41,886 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:41,886 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:41,887 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:41,887 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:41,888 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 16:07:41,889 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 16:07:41,889 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 16:07:41,890 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 16:07:41,890 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 16:07:41,891 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 16:07:41,891 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 16:07:41,892 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 16:07:41,892 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 16:07:41,893 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 16:07:41,894 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:07:41,894 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:07:41,895 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 16:07:41,895 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:07:41,895 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:07:41,896 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 16:07:41,896 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 16:07:42,304 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0005_000001 (auth:SIMPLE) 2023-07-24 16:07:43,056 WARN [Listener at jenkins-hbase4.apache.org/42941] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 16:07:43,061 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-24 16:07:43,203 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 16:07:43,213 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 16:07:43,213 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 16:07:43,321 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0006_000001 (auth:SIMPLE) 2023-07-24 16:07:50,138 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0006_000001 (auth:SIMPLE) 2023-07-24 16:07:53,347 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 16:07:53,348 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 16:07:53,353 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:53,354 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 16:07:53,354 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 16:07:53,354 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-526159531_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:53,355 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-24 16:07:53,355 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-24 16:07:53,355 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-526159531_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214860612/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214860612/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:53,355 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214860612/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-24 16:07:53,355 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214860612/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-24 16:07:53,360 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-24 16:07:53,361 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-24 16:07:53,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 16:07:53,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 16:07:53,365 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214873365"}]},"ts":"1690214873365"} 2023-07-24 16:07:53,366 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-24 16:07:53,368 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-24 16:07:53,369 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7941403c7fa46670b43414407571c4c0, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fe44aafe912136bfe432372d3c642bc3, UNASSIGN}] 2023-07-24 16:07:53,371 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7941403c7fa46670b43414407571c4c0, UNASSIGN 2023-07-24 16:07:53,371 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fe44aafe912136bfe432372d3c642bc3, UNASSIGN 2023-07-24 16:07:53,371 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=7941403c7fa46670b43414407571c4c0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:53,372 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690214873371"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214873371"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214873371"}]},"ts":"1690214873371"} 2023-07-24 16:07:53,372 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=fe44aafe912136bfe432372d3c642bc3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:53,372 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690214873372"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214873372"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214873372"}]},"ts":"1690214873372"} 2023-07-24 16:07:53,373 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 7941403c7fa46670b43414407571c4c0, server=jenkins-hbase4.apache.org,33053,1690214755222}] 2023-07-24 16:07:53,374 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure fe44aafe912136bfe432372d3c642bc3, server=jenkins-hbase4.apache.org,33229,1690214755329}] 2023-07-24 16:07:53,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 16:07:53,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7941403c7fa46670b43414407571c4c0 2023-07-24 16:07:53,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7941403c7fa46670b43414407571c4c0, disabling compactions & flushes 2023-07-24 16:07:53,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0. 2023-07-24 16:07:53,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0. 2023-07-24 16:07:53,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0. after waiting 0 ms 2023-07-24 16:07:53,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0. 2023-07-24 16:07:53,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fe44aafe912136bfe432372d3c642bc3 2023-07-24 16:07:53,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fe44aafe912136bfe432372d3c642bc3, disabling compactions & flushes 2023-07-24 16:07:53,529 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3. 2023-07-24 16:07:53,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3. 2023-07-24 16:07:53,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3. after waiting 0 ms 2023-07-24 16:07:53,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3. 2023-07-24 16:07:53,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testEmptyExportFileSystemState/7941403c7fa46670b43414407571c4c0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 16:07:53,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testEmptyExportFileSystemState/fe44aafe912136bfe432372d3c642bc3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 16:07:53,543 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:07:53,545 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0. 2023-07-24 16:07:53,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:07:53,545 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7941403c7fa46670b43414407571c4c0: 2023-07-24 16:07:53,546 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3. 2023-07-24 16:07:53,546 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fe44aafe912136bfe432372d3c642bc3: 2023-07-24 16:07:53,547 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7941403c7fa46670b43414407571c4c0 2023-07-24 16:07:53,550 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=7941403c7fa46670b43414407571c4c0, regionState=CLOSED 2023-07-24 16:07:53,550 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690214873550"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214873550"}]},"ts":"1690214873550"} 2023-07-24 16:07:53,550 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fe44aafe912136bfe432372d3c642bc3 2023-07-24 16:07:53,552 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=fe44aafe912136bfe432372d3c642bc3, regionState=CLOSED 2023-07-24 16:07:53,552 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690214873552"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214873552"}]},"ts":"1690214873552"} 2023-07-24 16:07:53,555 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-24 16:07:53,555 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 7941403c7fa46670b43414407571c4c0, server=jenkins-hbase4.apache.org,33053,1690214755222 in 180 msec 2023-07-24 16:07:53,556 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-24 16:07:53,556 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure fe44aafe912136bfe432372d3c642bc3, server=jenkins-hbase4.apache.org,33229,1690214755329 in 180 msec 2023-07-24 16:07:53,557 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=7941403c7fa46670b43414407571c4c0, UNASSIGN in 186 msec 2023-07-24 16:07:53,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-24 16:07:53,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=fe44aafe912136bfe432372d3c642bc3, UNASSIGN in 187 msec 2023-07-24 16:07:53,559 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214873559"}]},"ts":"1690214873559"} 2023-07-24 16:07:53,560 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-24 16:07:53,562 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-24 16:07:53,564 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 201 msec 2023-07-24 16:07:53,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 16:07:53,667 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-24 16:07:53,669 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-24 16:07:53,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 16:07:53,673 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 16:07:53,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-24 16:07:53,674 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 16:07:53,675 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33229] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-24 16:07:53,679 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 16:07:53,679 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 16:07:53,679 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 16:07:53,679 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 16:07:53,680 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 16:07:53,680 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 16:07:53,680 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 16:07:53,680 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 16:07:53,682 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe44aafe912136bfe432372d3c642bc3 2023-07-24 16:07:53,683 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7941403c7fa46670b43414407571c4c0 2023-07-24 16:07:53,683 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 16:07:53,683 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:53,683 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 16:07:53,683 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:53,683 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 16:07:53,684 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:53,684 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 16:07:53,684 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:53,685 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7941403c7fa46670b43414407571c4c0/cf, FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7941403c7fa46670b43414407571c4c0/recovered.edits] 2023-07-24 16:07:53,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-24 16:07:53,690 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe44aafe912136bfe432372d3c642bc3/cf, FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe44aafe912136bfe432372d3c642bc3/recovered.edits] 2023-07-24 16:07:53,700 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7941403c7fa46670b43414407571c4c0/cf/926c956e69de4c4db69d33a12826a209 to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testEmptyExportFileSystemState/7941403c7fa46670b43414407571c4c0/cf/926c956e69de4c4db69d33a12826a209 2023-07-24 16:07:53,703 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe44aafe912136bfe432372d3c642bc3/cf/fa7dfdc33c034246bb21ce0bac1c4136 to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testEmptyExportFileSystemState/fe44aafe912136bfe432372d3c642bc3/cf/fa7dfdc33c034246bb21ce0bac1c4136 2023-07-24 16:07:53,704 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7941403c7fa46670b43414407571c4c0/recovered.edits/9.seqid to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testEmptyExportFileSystemState/7941403c7fa46670b43414407571c4c0/recovered.edits/9.seqid 2023-07-24 16:07:53,707 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testEmptyExportFileSystemState/7941403c7fa46670b43414407571c4c0 2023-07-24 16:07:53,711 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe44aafe912136bfe432372d3c642bc3/recovered.edits/9.seqid to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testEmptyExportFileSystemState/fe44aafe912136bfe432372d3c642bc3/recovered.edits/9.seqid 2023-07-24 16:07:53,712 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testEmptyExportFileSystemState/fe44aafe912136bfe432372d3c642bc3 2023-07-24 16:07:53,712 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-24 16:07:53,712 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-24 16:07:53,713 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-24 16:07:53,719 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230724dd9150f3762244d18838ae4bd997e677 to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230724dd9150f3762244d18838ae4bd997e677 2023-07-24 16:07:53,721 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023072475ab052642774a6d8fe97792b0c3a62a to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e2023072475ab052642774a6d8fe97792b0c3a62a 2023-07-24 16:07:53,721 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-24 16:07:53,725 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 16:07:53,728 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-24 16:07:53,732 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-24 16:07:53,734 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 16:07:53,734 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-24 16:07:53,734 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690214873734"}]},"ts":"9223372036854775807"} 2023-07-24 16:07:53,734 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690214873734"}]},"ts":"9223372036854775807"} 2023-07-24 16:07:53,750 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 16:07:53,750 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7941403c7fa46670b43414407571c4c0, NAME => 'testtb-testEmptyExportFileSystemState,,1690214858335.7941403c7fa46670b43414407571c4c0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fe44aafe912136bfe432372d3c642bc3, NAME => 'testtb-testEmptyExportFileSystemState,1,1690214858335.fe44aafe912136bfe432372d3c642bc3.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 16:07:53,750 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-24 16:07:53,750 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690214873750"}]},"ts":"9223372036854775807"} 2023-07-24 16:07:53,752 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-24 16:07:53,755 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 16:07:53,756 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 86 msec 2023-07-24 16:07:53,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-24 16:07:53,792 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-24 16:07:53,802 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-24 16:07:53,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:53,806 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-24 16:07:53,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-24 16:07:53,841 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760 (was 756) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-526159531_17 at /127.0.0.1:41476 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:44695 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-526159531_17 at /127.0.0.1:54116 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x26dbae7d-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4672 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (638145229) connection to jenkins-hbase4.apache.org/172.31.14.131:46305 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-526159531_17 at /127.0.0.1:50712 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x26dbae7d-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2097716289_1 at /127.0.0.1:41440 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x26dbae7d-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x26dbae7d-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-2097716289_1 at /127.0.0.1:50692 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=902 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=644 (was 623) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 184), AvailableMemoryMB=4593 (was 5581) 2023-07-24 16:07:53,841 WARN [Listener at jenkins-hbase4.apache.org/42941] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-24 16:07:53,865 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=760, OpenFileDescriptor=902, MaxFileDescriptor=60000, SystemLoadAverage=644, ProcessCount=184, AvailableMemoryMB=4592 2023-07-24 16:07:53,865 WARN [Listener at jenkins-hbase4.apache.org/42941] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-24 16:07:53,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 16:07:53,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:53,874 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 16:07:53,874 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-24 16:07:53,878 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 16:07:53,882 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6c5e5e9c853e36f21acf99205bcb96e0 2023-07-24 16:07:53,882 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5f9c4c68b763f8e71438bd1cc831e349 2023-07-24 16:07:53,883 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6c5e5e9c853e36f21acf99205bcb96e0 empty. 2023-07-24 16:07:53,883 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5f9c4c68b763f8e71438bd1cc831e349 empty. 2023-07-24 16:07:53,883 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6c5e5e9c853e36f21acf99205bcb96e0 2023-07-24 16:07:53,885 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5f9c4c68b763f8e71438bd1cc831e349 2023-07-24 16:07:53,885 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-24 16:07:53,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 16:07:53,938 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-24 16:07:53,947 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6c5e5e9c853e36f21acf99205bcb96e0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp 2023-07-24 16:07:53,947 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5f9c4c68b763f8e71438bd1cc831e349, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp 2023-07-24 16:07:53,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 16:07:54,007 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:07:54,007 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 5f9c4c68b763f8e71438bd1cc831e349, disabling compactions & flushes 2023-07-24 16:07:54,007 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349. 2023-07-24 16:07:54,007 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349. 2023-07-24 16:07:54,007 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349. after waiting 0 ms 2023-07-24 16:07:54,007 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349. 2023-07-24 16:07:54,007 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349. 2023-07-24 16:07:54,007 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 5f9c4c68b763f8e71438bd1cc831e349: 2023-07-24 16:07:54,008 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:07:54,008 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 6c5e5e9c853e36f21acf99205bcb96e0, disabling compactions & flushes 2023-07-24 16:07:54,008 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0. 2023-07-24 16:07:54,008 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0. 2023-07-24 16:07:54,008 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0. after waiting 0 ms 2023-07-24 16:07:54,008 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0. 2023-07-24 16:07:54,008 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0. 2023-07-24 16:07:54,008 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 6c5e5e9c853e36f21acf99205bcb96e0: 2023-07-24 16:07:54,011 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 16:07:54,011 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690214874011"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214874011"}]},"ts":"1690214874011"} 2023-07-24 16:07:54,012 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690214874011"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214874011"}]},"ts":"1690214874011"} 2023-07-24 16:07:54,014 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 16:07:54,014 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 16:07:54,015 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214874015"}]},"ts":"1690214874015"} 2023-07-24 16:07:54,016 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-24 16:07:54,020 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 16:07:54,021 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 16:07:54,021 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 16:07:54,021 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 16:07:54,021 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 16:07:54,021 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6c5e5e9c853e36f21acf99205bcb96e0, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5f9c4c68b763f8e71438bd1cc831e349, ASSIGN}] 2023-07-24 16:07:54,026 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5f9c4c68b763f8e71438bd1cc831e349, ASSIGN 2023-07-24 16:07:54,026 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6c5e5e9c853e36f21acf99205bcb96e0, ASSIGN 2023-07-24 16:07:54,027 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6c5e5e9c853e36f21acf99205bcb96e0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33229,1690214755329; forceNewPlan=false, retain=false 2023-07-24 16:07:54,027 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5f9c4c68b763f8e71438bd1cc831e349, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33053,1690214755222; forceNewPlan=false, retain=false 2023-07-24 16:07:54,177 INFO [jenkins-hbase4:43489] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 16:07:54,180 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=5f9c4c68b763f8e71438bd1cc831e349, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:54,180 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=6c5e5e9c853e36f21acf99205bcb96e0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:54,181 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690214874180"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214874180"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214874180"}]},"ts":"1690214874180"} 2023-07-24 16:07:54,181 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690214874180"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214874180"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214874180"}]},"ts":"1690214874180"} 2023-07-24 16:07:54,183 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 5f9c4c68b763f8e71438bd1cc831e349, server=jenkins-hbase4.apache.org,33053,1690214755222}] 2023-07-24 16:07:54,187 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 6c5e5e9c853e36f21acf99205bcb96e0, server=jenkins-hbase4.apache.org,33229,1690214755329}] 2023-07-24 16:07:54,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 16:07:54,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349. 2023-07-24 16:07:54,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5f9c4c68b763f8e71438bd1cc831e349, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 16:07:54,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0. 2023-07-24 16:07:54,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6c5e5e9c853e36f21acf99205bcb96e0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 16:07:54,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349. service=AccessControlService 2023-07-24 16:07:54,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0. service=AccessControlService 2023-07-24 16:07:54,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 16:07:54,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 5f9c4c68b763f8e71438bd1cc831e349 2023-07-24 16:07:54,344 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 16:07:54,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:07:54,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 6c5e5e9c853e36f21acf99205bcb96e0 2023-07-24 16:07:54,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5f9c4c68b763f8e71438bd1cc831e349 2023-07-24 16:07:54,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 16:07:54,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5f9c4c68b763f8e71438bd1cc831e349 2023-07-24 16:07:54,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6c5e5e9c853e36f21acf99205bcb96e0 2023-07-24 16:07:54,345 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6c5e5e9c853e36f21acf99205bcb96e0 2023-07-24 16:07:54,348 INFO [StoreOpener-5f9c4c68b763f8e71438bd1cc831e349-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5f9c4c68b763f8e71438bd1cc831e349 2023-07-24 16:07:54,348 INFO [StoreOpener-6c5e5e9c853e36f21acf99205bcb96e0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6c5e5e9c853e36f21acf99205bcb96e0 2023-07-24 16:07:54,350 DEBUG [StoreOpener-5f9c4c68b763f8e71438bd1cc831e349-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithSkipTmp/5f9c4c68b763f8e71438bd1cc831e349/cf 2023-07-24 16:07:54,350 DEBUG [StoreOpener-6c5e5e9c853e36f21acf99205bcb96e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithSkipTmp/6c5e5e9c853e36f21acf99205bcb96e0/cf 2023-07-24 16:07:54,350 DEBUG [StoreOpener-5f9c4c68b763f8e71438bd1cc831e349-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithSkipTmp/5f9c4c68b763f8e71438bd1cc831e349/cf 2023-07-24 16:07:54,350 DEBUG [StoreOpener-6c5e5e9c853e36f21acf99205bcb96e0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithSkipTmp/6c5e5e9c853e36f21acf99205bcb96e0/cf 2023-07-24 16:07:54,351 INFO [StoreOpener-5f9c4c68b763f8e71438bd1cc831e349-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f9c4c68b763f8e71438bd1cc831e349 columnFamilyName cf 2023-07-24 16:07:54,351 INFO [StoreOpener-6c5e5e9c853e36f21acf99205bcb96e0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6c5e5e9c853e36f21acf99205bcb96e0 columnFamilyName cf 2023-07-24 16:07:54,352 INFO [StoreOpener-5f9c4c68b763f8e71438bd1cc831e349-1] regionserver.HStore(310): Store=5f9c4c68b763f8e71438bd1cc831e349/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 16:07:54,353 INFO [StoreOpener-6c5e5e9c853e36f21acf99205bcb96e0-1] regionserver.HStore(310): Store=6c5e5e9c853e36f21acf99205bcb96e0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 16:07:54,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithSkipTmp/5f9c4c68b763f8e71438bd1cc831e349 2023-07-24 16:07:54,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithSkipTmp/6c5e5e9c853e36f21acf99205bcb96e0 2023-07-24 16:07:54,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithSkipTmp/6c5e5e9c853e36f21acf99205bcb96e0 2023-07-24 16:07:54,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithSkipTmp/5f9c4c68b763f8e71438bd1cc831e349 2023-07-24 16:07:54,360 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5f9c4c68b763f8e71438bd1cc831e349 2023-07-24 16:07:54,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6c5e5e9c853e36f21acf99205bcb96e0 2023-07-24 16:07:54,363 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithSkipTmp/5f9c4c68b763f8e71438bd1cc831e349/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 16:07:54,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5f9c4c68b763f8e71438bd1cc831e349; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69212082, jitterRate=0.03134039044380188}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 16:07:54,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5f9c4c68b763f8e71438bd1cc831e349: 2023-07-24 16:07:54,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349., pid=108, masterSystemTime=1690214874338 2023-07-24 16:07:54,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithSkipTmp/6c5e5e9c853e36f21acf99205bcb96e0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 16:07:54,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6c5e5e9c853e36f21acf99205bcb96e0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67446570, jitterRate=0.005032211542129517}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 16:07:54,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6c5e5e9c853e36f21acf99205bcb96e0: 2023-07-24 16:07:54,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349. 2023-07-24 16:07:54,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349. 2023-07-24 16:07:54,367 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=5f9c4c68b763f8e71438bd1cc831e349, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:54,367 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0., pid=109, masterSystemTime=1690214874339 2023-07-24 16:07:54,368 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690214874367"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690214874367"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690214874367"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690214874367"}]},"ts":"1690214874367"} 2023-07-24 16:07:54,369 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0. 2023-07-24 16:07:54,369 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0. 2023-07-24 16:07:54,370 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=6c5e5e9c853e36f21acf99205bcb96e0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:54,370 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690214874370"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690214874370"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690214874370"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690214874370"}]},"ts":"1690214874370"} 2023-07-24 16:07:54,372 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-24 16:07:54,372 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 5f9c4c68b763f8e71438bd1cc831e349, server=jenkins-hbase4.apache.org,33053,1690214755222 in 187 msec 2023-07-24 16:07:54,373 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5f9c4c68b763f8e71438bd1cc831e349, ASSIGN in 351 msec 2023-07-24 16:07:54,373 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-24 16:07:54,373 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 6c5e5e9c853e36f21acf99205bcb96e0, server=jenkins-hbase4.apache.org,33229,1690214755329 in 185 msec 2023-07-24 16:07:54,375 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-24 16:07:54,375 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6c5e5e9c853e36f21acf99205bcb96e0, ASSIGN in 352 msec 2023-07-24 16:07:54,376 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 16:07:54,376 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214874376"}]},"ts":"1690214874376"} 2023-07-24 16:07:54,379 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-24 16:07:54,382 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 16:07:54,382 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-24 16:07:54,384 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33229] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 16:07:54,386 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:54,386 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:54,386 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:54,386 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:07:54,389 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 16:07:54,389 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 16:07:54,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 16:07:54,390 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 16:07:54,391 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 522 msec 2023-07-24 16:07:54,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 16:07:54,503 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-24 16:07:54,506 DEBUG [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,506 DEBUG [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0. 2023-07-24 16:07:54,509 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 16:07:54,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 16:07:54,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690214874538 (current time:1690214874538). 2023-07-24 16:07:54,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 16:07:54,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(139): Connect 0x73d51f81 to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:07:54,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@527c3d28, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:07:54,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:07:54,569 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52706, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:07:54,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73d51f81 to 127.0.0.1:49766 2023-07-24 16:07:54,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:07:54,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(139): Connect 0x3447fef9 to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:07:54,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fb5d6e7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:07:54,592 DEBUG [hconnection-0x5c133344-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:07:54,593 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52714, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:07:54,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3447fef9 to 127.0.0.1:49766 2023-07-24 16:07:54,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:07:54,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 16:07:54,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 16:07:54,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 16:07:54,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 16:07:54,604 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 16:07:54,605 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690215474605 2023-07-24 16:07:54,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 16:07:54,605 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,606 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 16:07:54,607 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 16:07:54,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 16:07:54,608 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 16:07:54,609 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-24 16:07:54,610 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 16:07:54,611 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690215474611 2023-07-24 16:07:54,638 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,639 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-24 16:07:54,639 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:54,641 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-24 16:07:54,641 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-24 16:07:54,641 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,641 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,643 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:54,643 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:54,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:54,644 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:54,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:54,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:54,644 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:54,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:54,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:54,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:54,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,645 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,645 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 16:07:54,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,647 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 16:07:54,647 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,647 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:54,647 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:54,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 16:07:54,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,648 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 16:07:54,648 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:54,648 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 16:07:54,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 16:07:54,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,648 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 16:07:54,650 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,651 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,651 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 16:07:54,651 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 16:07:54,651 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:54,651 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:54,656 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,658 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 16:07:54,658 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 16:07:54,658 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 16:07:54,658 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 16:07:54,659 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33229,1690214755329' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 16:07:54,659 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:54,659 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 16:07:54,660 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 16:07:54,660 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 16:07:54,660 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33053,1690214755222' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 16:07:54,660 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38047,1690214755282' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 16:07:54,666 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:54,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:54,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:54,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:54,666 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:54,667 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,668 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:54,668 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,668 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:07:54,668 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,668 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:07:54,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,669 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:54,669 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,669 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:07:54,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:54,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:54,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:54,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:54,672 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33053,1690214755222' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 16:07:54,672 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c75518c[Count = 1] remaining members to acquire global barrier 2023-07-24 16:07:54,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:54,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:54,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:54,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:54,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:54,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:54,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:54,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:54,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:54,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33229,1690214755329' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 16:07:54,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6c75518c[Count = 0] remaining members to acquire global barrier 2023-07-24 16:07:54,677 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-24 16:07:54,677 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,679 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,679 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,679 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,679 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 16:07:54,679 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 16:07:54,679 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38047,1690214755282' in zk 2023-07-24 16:07:54,679 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:54,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,679 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 16:07:54,680 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:54,680 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 16:07:54,681 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 16:07:54,681 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 16:07:54,681 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:54,681 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 16:07:54,686 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 16:07:54,686 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 16:07:54,686 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 16:07:54,686 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 16:07:54,687 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349. 2023-07-24 16:07:54,687 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349. started... 2023-07-24 16:07:54,686 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0. 2023-07-24 16:07:54,689 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0. started... 2023-07-24 16:07:54,689 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6c5e5e9c853e36f21acf99205bcb96e0: 2023-07-24 16:07:54,689 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5f9c4c68b763f8e71438bd1cc831e349: 2023-07-24 16:07:54,689 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,689 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,689 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 16:07:54,689 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 16:07:54,689 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 16:07:54,689 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 16:07:54,707 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:07:54,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 16:07:54,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 16:07:54,708 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 16:07:54,748 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349. completed. 2023-07-24 16:07:54,749 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349. 2023-07-24 16:07:54,749 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 16:07:54,749 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 16:07:54,749 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:54,749 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 16:07:54,749 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33053,1690214755222' in zk 2023-07-24 16:07:54,749 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0. completed. 2023-07-24 16:07:54,749 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0. 2023-07-24 16:07:54,749 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 16:07:54,749 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 16:07:54,749 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:54,749 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 16:07:54,749 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33229,1690214755329' in zk 2023-07-24 16:07:54,752 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:54,752 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 16:07:54,752 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:54,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:54,752 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 16:07:54,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:54,753 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:54,753 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 16:07:54,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:54,753 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:54,753 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 16:07:54,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:54,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:54,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:54,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:54,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:54,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:54,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:54,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:54,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:54,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33053,1690214755222': 2023-07-24 16:07:54,762 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33053,1690214755222' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-24 16:07:54,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:54,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:54,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:54,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:54,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:54,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:54,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:54,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:54,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:54,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:54,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:54,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:54,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33229,1690214755329': 2023-07-24 16:07:54,777 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33229,1690214755329' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-24 16:07:54,777 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-24 16:07:54,777 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 16:07:54,777 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 16:07:54,777 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,777 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 16:07:54,780 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,780 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:54,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:54,780 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,780 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,780 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:54,780 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:54,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,780 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:54,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:54,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:54,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:54,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:54,781 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:54,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:54,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:54,783 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:54,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,783 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:54,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:54,784 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:54,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:54,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:54,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:54,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:54,787 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:54,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,788 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:54,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:54,788 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:54,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:54,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:54,792 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:54,792 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:54,792 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:54,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:54,792 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:54,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:54,792 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,792 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:54,792 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:54,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:54,792 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:54,792 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:54,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:54,792 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:54,792 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:54,792 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:54,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:54,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:54,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 16:07:54,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:54,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:54,794 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:54,794 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,795 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:54,795 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,795 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:54,795 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:54,795 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,795 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:54,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:54,795 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 16:07:54,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,812 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,836 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,856 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-24 16:07:54,856 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,857 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690214874605Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1690214874811 (+206 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690214874811Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690214874811Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690214874815 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690214874830 (+15 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690214874856 (+26 ms) 2023-07-24 16:07:54,860 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 16:07:54,862 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 254 msec 2023-07-24 16:07:54,908 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:07:54,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 16:07:54,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 16:07:54,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33229] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 16:07:54,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33053] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 16:07:54,917 DEBUG [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,917 DEBUG [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0. 2023-07-24 16:07:54,917 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 16:07:54,928 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 16:07:54,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690214874928 (current time:1690214874928). 2023-07-24 16:07:54,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 16:07:54,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(139): Connect 0x687d16f6 to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:07:54,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d3191ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:07:54,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:07:54,944 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52720, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:07:54,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x687d16f6 to 127.0.0.1:49766 2023-07-24 16:07:54,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:07:54,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(139): Connect 0x7ac94577 to 127.0.0.1:49766 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 16:07:54,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a03267e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 16:07:54,967 DEBUG [hconnection-0x5b1e7471-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 16:07:54,971 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52724, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 16:07:54,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ac94577 to 127.0.0.1:49766 2023-07-24 16:07:54,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:07:54,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 16:07:54,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 16:07:54,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 16:07:54,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 16:07:54,981 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 16:07:54,982 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690215474982 2023-07-24 16:07:54,982 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:54,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 16:07:54,984 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 16:07:54,984 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 16:07:54,985 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 16:07:54,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 16:07:54,987 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-24 16:07:54,988 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 16:07:54,989 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690215474989 2023-07-24 16:07:55,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,023 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-24 16:07:55,023 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:55,024 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-24 16:07:55,024 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-24 16:07:55,025 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,025 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,027 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:55,027 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:55,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:55,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:55,027 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:55,027 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:55,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,027 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:55,028 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 16:07:55,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 16:07:55,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,028 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 16:07:55,031 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:55,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:55,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:55,031 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:55,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:55,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:55,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 16:07:55,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,033 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 16:07:55,033 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 16:07:55,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,034 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 16:07:55,034 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,035 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 16:07:55,035 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:55,038 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,040 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,040 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 16:07:55,040 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 16:07:55,040 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 16:07:55,040 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:55,040 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 16:07:55,042 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 16:07:55,042 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 16:07:55,042 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33053,1690214755222' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 16:07:55,040 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,38047,1690214755282' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 16:07:55,042 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 16:07:55,044 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 16:07:55,044 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 16:07:55,044 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33229,1690214755329' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 16:07:55,047 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:55,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:55,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:55,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:55,047 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,047 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,048 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:55,048 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:55,049 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,050 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,050 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:07:55,050 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:07:55,050 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:55,050 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 16:07:55,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:55,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:55,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:55,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:55,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33053,1690214755222' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 16:07:55,052 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e09a177[Count = 1] remaining members to acquire global barrier 2023-07-24 16:07:55,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:55,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:55,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:55,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:55,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:55,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:55,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:55,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:55,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:55,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33229,1690214755329' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 16:07:55,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e09a177[Count = 0] remaining members to acquire global barrier 2023-07-24 16:07:55,055 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-24 16:07:55,055 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,062 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,062 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,062 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:55,062 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,062 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 16:07:55,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,062 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 16:07:55,062 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 16:07:55,062 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 16:07:55,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,062 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349. 2023-07-24 16:07:55,063 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 16:07:55,063 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349. started... 2023-07-24 16:07:55,062 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:55,063 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0. 2023-07-24 16:07:55,063 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 16:07:55,063 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 16:07:55,063 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0. started... 2023-07-24 16:07:55,063 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 16:07:55,063 INFO [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5f9c4c68b763f8e71438bd1cc831e349 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-07-24 16:07:55,063 INFO [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6c5e5e9c853e36f21acf99205bcb96e0 1/1 column families, dataSize=65 B heapSize=400 B 2023-07-24 16:07:55,063 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 16:07:55,063 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,38047,1690214755282' in zk 2023-07-24 16:07:55,065 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 16:07:55,065 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:55,065 DEBUG [member: 'jenkins-hbase4.apache.org,38047,1690214755282' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 16:07:55,084 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:07:55,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 16:07:55,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 16:07:55,085 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 16:07:55,108 INFO [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307243338643d781242fdb0110db176399690 to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307243338643d781242fdb0110db176399690 2023-07-24 16:07:55,127 INFO [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithSkipTmp/5f9c4c68b763f8e71438bd1cc831e349/.tmp/cf/23a52935407b41abbf164c5312bfc283 2023-07-24 16:07:55,131 INFO [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230724d40bbc3352814c808fd5283703812c51 to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230724d40bbc3352814c808fd5283703812c51 2023-07-24 16:07:55,132 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithSkipTmp/5f9c4c68b763f8e71438bd1cc831e349/.tmp/cf/23a52935407b41abbf164c5312bfc283 as hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithSkipTmp/5f9c4c68b763f8e71438bd1cc831e349/cf/23a52935407b41abbf164c5312bfc283 2023-07-24 16:07:55,138 INFO [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithSkipTmp/5f9c4c68b763f8e71438bd1cc831e349/cf/23a52935407b41abbf164c5312bfc283, entries=49, sequenceid=6, filesize=13.7 K 2023-07-24 16:07:55,139 INFO [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 5f9c4c68b763f8e71438bd1cc831e349 in 76ms, sequenceid=6, compaction requested=false 2023-07-24 16:07:55,139 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-24 16:07:55,139 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5f9c4c68b763f8e71438bd1cc831e349: 2023-07-24 16:07:55,140 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,140 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 16:07:55,140 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithSkipTmp/5f9c4c68b763f8e71438bd1cc831e349/cf/23a52935407b41abbf164c5312bfc283] hfiles 2023-07-24 16:07:55,140 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithSkipTmp/5f9c4c68b763f8e71438bd1cc831e349/cf/23a52935407b41abbf164c5312bfc283 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,143 INFO [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithSkipTmp/6c5e5e9c853e36f21acf99205bcb96e0/.tmp/cf/cf1d9dcf2ae643f49e6a9b000df749ed 2023-07-24 16:07:55,148 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithSkipTmp/6c5e5e9c853e36f21acf99205bcb96e0/.tmp/cf/cf1d9dcf2ae643f49e6a9b000df749ed as hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithSkipTmp/6c5e5e9c853e36f21acf99205bcb96e0/cf/cf1d9dcf2ae643f49e6a9b000df749ed 2023-07-24 16:07:55,152 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349. completed. 2023-07-24 16:07:55,152 DEBUG [rs(jenkins-hbase4.apache.org,33053,1690214755222)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349. 2023-07-24 16:07:55,152 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 16:07:55,152 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 16:07:55,152 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:55,152 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 16:07:55,152 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33053,1690214755222' in zk 2023-07-24 16:07:55,154 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 16:07:55,154 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:55,154 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:55,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:55,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:55,154 DEBUG [member: 'jenkins-hbase4.apache.org,33053,1690214755222' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 16:07:55,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:55,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:55,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:55,157 INFO [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithSkipTmp/6c5e5e9c853e36f21acf99205bcb96e0/cf/cf1d9dcf2ae643f49e6a9b000df749ed, entries=1, sequenceid=6, filesize=5.1 K 2023-07-24 16:07:55,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,158 INFO [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 6c5e5e9c853e36f21acf99205bcb96e0 in 95ms, sequenceid=6, compaction requested=false 2023-07-24 16:07:55,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:55,160 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6c5e5e9c853e36f21acf99205bcb96e0: 2023-07-24 16:07:55,160 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,160 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 16:07:55,160 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithSkipTmp/6c5e5e9c853e36f21acf99205bcb96e0/cf/cf1d9dcf2ae643f49e6a9b000df749ed] hfiles 2023-07-24 16:07:55,160 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithSkipTmp/6c5e5e9c853e36f21acf99205bcb96e0/cf/cf1d9dcf2ae643f49e6a9b000df749ed for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:55,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:55,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:55,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:55,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:55,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33053,1690214755222': 2023-07-24 16:07:55,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33053,1690214755222' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-24 16:07:55,183 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0. completed. 2023-07-24 16:07:55,183 DEBUG [rs(jenkins-hbase4.apache.org,33229,1690214755329)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0. 2023-07-24 16:07:55,183 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 16:07:55,183 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 16:07:55,183 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:55,183 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 16:07:55,183 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33229,1690214755329' in zk 2023-07-24 16:07:55,186 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:55,186 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 16:07:55,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:55,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:55,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:55,186 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:55,187 DEBUG [member: 'jenkins-hbase4.apache.org,33229,1690214755329' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 16:07:55,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:55,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:55,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:55,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:55,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:55,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:55,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:55,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:55,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:55,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,33229,1690214755329': 2023-07-24 16:07:55,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33229,1690214755329' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-24 16:07:55,193 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-24 16:07:55,193 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 16:07:55,193 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 16:07:55,193 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,193 INFO [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 16:07:55,196 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,196 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,196 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,196 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:55,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,196 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:55,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 16:07:55,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 16:07:55,196 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:55,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:55,196 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:55,196 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:55,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:55,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 16:07:55,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:55,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:55,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:55,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,198 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:55,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,198 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:55,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 16:07:55,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:55,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:55,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:55,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 16:07:55,200 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:55,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,201 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:55,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:55,201 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:55,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:55,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:55,205 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:55,205 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:55,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:55,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:55,206 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:55,206 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:55,206 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 16:07:55,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:55,206 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 16:07:55,206 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:55,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 16:07:55,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:55,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 16:07:55,206 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,206 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:55,206 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:55,206 DEBUG [(jenkins-hbase4.apache.org,43489,1690214753588)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 16:07:55,206 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,206 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:07:55,206 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,206 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:55,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:55,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:55,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:55,206 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:07:55,209 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:07:55,209 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,209 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 16:07:55,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 16:07:55,208 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,209 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,209 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 16:07:55,210 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307243338643d781242fdb0110db176399690, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230724d40bbc3352814c808fd5283703812c51] mob files 2023-07-24 16:07:55,210 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307243338643d781242fdb0110db176399690 2023-07-24 16:07:55,210 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230724d40bbc3352814c808fd5283703812c51 2023-07-24 16:07:55,285 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:07:55,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 16:07:55,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 16:07:55,287 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 16:07:55,587 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:07:55,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 16:07:55,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 16:07:55,589 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 16:07:55,634 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,658 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,696 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-24 16:07:55,697 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,697 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:55,697 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690214874982Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1690214875634 (+652 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690214875634Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1690214875634Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1690214875641 (+7 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690214875652 (+11 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690214875696 (+44 ms) 2023-07-24 16:07:55,700 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 16:07:55,702 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 717 msec 2023-07-24 16:07:56,089 DEBUG [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 16:07:56,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 16:07:56,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 16:07:56,091 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214876091 2023-07-24 16:07:56,091 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:32943, tgtDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214876091, rawTgtDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214876091, srcFsUri=hdfs://localhost:32943, srcDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0 2023-07-24 16:07:56,123 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:32943, inputRoot=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0 2023-07-24 16:07:56,123 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2114372672_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214876091, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214876091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:56,123 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:32943, inputRoot=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0, snapshotDir=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-24 16:07:56,140 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214876091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:07:56,226 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:56,226 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:56,227 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:56,228 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:57,326 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/hadoop-8960537605181392805.jar 2023-07-24 16:07:57,327 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:57,327 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:57,422 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/hadoop-2204037616308082130.jar 2023-07-24 16:07:57,423 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:57,423 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:57,424 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:57,424 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:57,425 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:57,425 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 16:07:57,425 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 16:07:57,426 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 16:07:57,426 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 16:07:57,427 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 16:07:57,427 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 16:07:57,428 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 16:07:57,428 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 16:07:57,428 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 16:07:57,429 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 16:07:57,429 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 16:07:57,430 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:07:57,431 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:07:57,432 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 16:07:57,432 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:07:57,432 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 16:07:57,433 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 16:07:57,434 DEBUG [Listener at jenkins-hbase4.apache.org/42941] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 16:07:57,518 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0006_000001 (auth:SIMPLE) 2023-07-24 16:07:58,732 WARN [Listener at jenkins-hbase4.apache.org/42941] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 16:07:58,735 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-24 16:07:58,737 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-24 16:07:58,816 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 16:07:58,816 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 16:07:59,132 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 16:07:59,523 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0007_000001 (auth:SIMPLE) 2023-07-24 16:08:06,326 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0007_000001 (auth:SIMPLE) 2023-07-24 16:08:08,643 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0007_000001 (auth:SIMPLE) 2023-07-24 16:08:12,787 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0007_000001 (auth:SIMPLE) 2023-07-24 16:08:13,974 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 16:08:13,974 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 16:08:13,986 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:08:13,986 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 16:08:13,987 INFO [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 16:08:13,987 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-526159531_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:08:13,988 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-24 16:08:13,988 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-24 16:08:13,988 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-526159531_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214876091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214876091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:08:13,989 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214876091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-24 16:08:13,989 DEBUG [Listener at jenkins-hbase4.apache.org/42941] snapshot.TestExportSnapshot(367): hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/export-test/export-1690214876091/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-24 16:08:13,996 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:08:13,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:08:13,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:08:14,001 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214894001"}]},"ts":"1690214894001"} 2023-07-24 16:08:14,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 16:08:14,003 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-24 16:08:14,004 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-24 16:08:14,009 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6c5e5e9c853e36f21acf99205bcb96e0, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5f9c4c68b763f8e71438bd1cc831e349, UNASSIGN}] 2023-07-24 16:08:14,012 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6c5e5e9c853e36f21acf99205bcb96e0, UNASSIGN 2023-07-24 16:08:14,012 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5f9c4c68b763f8e71438bd1cc831e349, UNASSIGN 2023-07-24 16:08:14,013 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=6c5e5e9c853e36f21acf99205bcb96e0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:08:14,013 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=5f9c4c68b763f8e71438bd1cc831e349, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:08:14,013 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690214894013"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214894013"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214894013"}]},"ts":"1690214894013"} 2023-07-24 16:08:14,013 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690214894013"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690214894013"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690214894013"}]},"ts":"1690214894013"} 2023-07-24 16:08:14,015 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure 6c5e5e9c853e36f21acf99205bcb96e0, server=jenkins-hbase4.apache.org,33229,1690214755329}] 2023-07-24 16:08:14,016 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 5f9c4c68b763f8e71438bd1cc831e349, server=jenkins-hbase4.apache.org,33053,1690214755222}] 2023-07-24 16:08:14,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 16:08:14,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6c5e5e9c853e36f21acf99205bcb96e0 2023-07-24 16:08:14,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5f9c4c68b763f8e71438bd1cc831e349 2023-07-24 16:08:14,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5f9c4c68b763f8e71438bd1cc831e349, disabling compactions & flushes 2023-07-24 16:08:14,168 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349. 2023-07-24 16:08:14,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349. 2023-07-24 16:08:14,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349. after waiting 0 ms 2023-07-24 16:08:14,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349. 2023-07-24 16:08:14,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6c5e5e9c853e36f21acf99205bcb96e0, disabling compactions & flushes 2023-07-24 16:08:14,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0. 2023-07-24 16:08:14,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0. 2023-07-24 16:08:14,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0. after waiting 0 ms 2023-07-24 16:08:14,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0. 2023-07-24 16:08:14,199 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithSkipTmp/5f9c4c68b763f8e71438bd1cc831e349/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 16:08:14,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/default/testtb-testExportFileSystemStateWithSkipTmp/6c5e5e9c853e36f21acf99205bcb96e0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 16:08:14,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:08:14,202 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0. 2023-07-24 16:08:14,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6c5e5e9c853e36f21acf99205bcb96e0: 2023-07-24 16:08:14,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:08:14,203 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349. 2023-07-24 16:08:14,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5f9c4c68b763f8e71438bd1cc831e349: 2023-07-24 16:08:14,207 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5f9c4c68b763f8e71438bd1cc831e349 2023-07-24 16:08:14,208 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=5f9c4c68b763f8e71438bd1cc831e349, regionState=CLOSED 2023-07-24 16:08:14,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6c5e5e9c853e36f21acf99205bcb96e0 2023-07-24 16:08:14,208 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690214894208"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214894208"}]},"ts":"1690214894208"} 2023-07-24 16:08:14,209 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=6c5e5e9c853e36f21acf99205bcb96e0, regionState=CLOSED 2023-07-24 16:08:14,209 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690214894209"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690214894209"}]},"ts":"1690214894209"} 2023-07-24 16:08:14,216 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-24 16:08:14,216 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 5f9c4c68b763f8e71438bd1cc831e349, server=jenkins-hbase4.apache.org,33053,1690214755222 in 195 msec 2023-07-24 16:08:14,216 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-24 16:08:14,216 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure 6c5e5e9c853e36f21acf99205bcb96e0, server=jenkins-hbase4.apache.org,33229,1690214755329 in 196 msec 2023-07-24 16:08:14,217 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=5f9c4c68b763f8e71438bd1cc831e349, UNASSIGN in 207 msec 2023-07-24 16:08:14,217 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-24 16:08:14,217 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6c5e5e9c853e36f21acf99205bcb96e0, UNASSIGN in 207 msec 2023-07-24 16:08:14,218 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690214894218"}]},"ts":"1690214894218"} 2023-07-24 16:08:14,219 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-24 16:08:14,224 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-24 16:08:14,227 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 229 msec 2023-07-24 16:08:14,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 16:08:14,307 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-24 16:08:14,308 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:08:14,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:08:14,313 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:08:14,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:08:14,314 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:08:14,316 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=33229] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:08:14,320 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:08:14,320 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:08:14,320 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:08:14,320 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:08:14,320 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 16:08:14,321 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 16:08:14,321 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 16:08:14,321 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 16:08:14,322 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:08:14,322 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:08:14,323 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:08:14,323 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:08:14,323 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:08:14,323 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:08:14,323 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:08:14,323 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 16:08:14,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-24 16:08:14,329 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5f9c4c68b763f8e71438bd1cc831e349 2023-07-24 16:08:14,329 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6c5e5e9c853e36f21acf99205bcb96e0 2023-07-24 16:08:14,342 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6c5e5e9c853e36f21acf99205bcb96e0/cf, FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6c5e5e9c853e36f21acf99205bcb96e0/recovered.edits] 2023-07-24 16:08:14,342 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5f9c4c68b763f8e71438bd1cc831e349/cf, FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5f9c4c68b763f8e71438bd1cc831e349/recovered.edits] 2023-07-24 16:08:14,347 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6c5e5e9c853e36f21acf99205bcb96e0/cf/cf1d9dcf2ae643f49e6a9b000df749ed to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6c5e5e9c853e36f21acf99205bcb96e0/cf/cf1d9dcf2ae643f49e6a9b000df749ed 2023-07-24 16:08:14,349 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5f9c4c68b763f8e71438bd1cc831e349/cf/23a52935407b41abbf164c5312bfc283 to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/5f9c4c68b763f8e71438bd1cc831e349/cf/23a52935407b41abbf164c5312bfc283 2023-07-24 16:08:14,352 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6c5e5e9c853e36f21acf99205bcb96e0/recovered.edits/9.seqid to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6c5e5e9c853e36f21acf99205bcb96e0/recovered.edits/9.seqid 2023-07-24 16:08:14,353 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6c5e5e9c853e36f21acf99205bcb96e0 2023-07-24 16:08:14,355 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5f9c4c68b763f8e71438bd1cc831e349/recovered.edits/9.seqid to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/5f9c4c68b763f8e71438bd1cc831e349/recovered.edits/9.seqid 2023-07-24 16:08:14,356 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/5f9c4c68b763f8e71438bd1cc831e349 2023-07-24 16:08:14,356 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-24 16:08:14,356 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-24 16:08:14,357 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-24 16:08:14,361 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307243338643d781242fdb0110db176399690 to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b202307243338643d781242fdb0110db176399690 2023-07-24 16:08:14,363 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230724d40bbc3352814c808fd5283703812c51 to hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230724d40bbc3352814c808fd5283703812c51 2023-07-24 16:08:14,363 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-24 16:08:14,365 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:08:14,368 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-24 16:08:14,370 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-24 16:08:14,371 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:08:14,371 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-24 16:08:14,371 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690214894371"}]},"ts":"9223372036854775807"} 2023-07-24 16:08:14,371 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690214894371"}]},"ts":"9223372036854775807"} 2023-07-24 16:08:14,373 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 16:08:14,373 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6c5e5e9c853e36f21acf99205bcb96e0, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690214873867.6c5e5e9c853e36f21acf99205bcb96e0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5f9c4c68b763f8e71438bd1cc831e349, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690214873867.5f9c4c68b763f8e71438bd1cc831e349.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 16:08:14,373 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-24 16:08:14,373 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690214894373"}]},"ts":"9223372036854775807"} 2023-07-24 16:08:14,375 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-24 16:08:14,379 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 16:08:14,382 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 71 msec 2023-07-24 16:08:14,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-24 16:08:14,426 INFO [Listener at jenkins-hbase4.apache.org/42941] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-24 16:08:14,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-24 16:08:14,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:08:14,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-24 16:08:14,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43489] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 16:08:14,469 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=760 (was 760), OpenFileDescriptor=897 (was 902), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=691 (was 644) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 184), AvailableMemoryMB=4684 (was 4592) - AvailableMemoryMB LEAK? - 2023-07-24 16:08:14,469 WARN [Listener at jenkins-hbase4.apache.org/42941] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-24 16:08:14,469 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-24 16:08:14,483 INFO [Listener at jenkins-hbase4.apache.org/42941] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 16:08:18,996 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690214764378_0007_000001 (auth:SIMPLE) 2023-07-24 16:08:19,780 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 16:08:28,611 INFO [Listener at jenkins-hbase4.apache.org/42941] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 16:08:42,744 ERROR [Thread[Thread-411,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 16:08:42,745 INFO [Listener at jenkins-hbase4.apache.org/42941] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 16:08:42,869 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-24 16:08:42,881 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-24 16:08:42,882 ERROR [Thread[Thread-421,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 16:08:42,920 INFO [Listener at jenkins-hbase4.apache.org/42941] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 16:08:43,027 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 16:08:43,027 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-24 16:08:43,027 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-24 16:08:43,027 INFO [Listener at jenkins-hbase4.apache.org/42941] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-24 16:08:43,027 DEBUG [Listener at jenkins-hbase4.apache.org/42941] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5356fd15 to 127.0.0.1:49766 2023-07-24 16:08:43,028 DEBUG [Listener at jenkins-hbase4.apache.org/42941] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:08:43,028 DEBUG [Listener at jenkins-hbase4.apache.org/42941] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-24 16:08:43,028 DEBUG [Listener at jenkins-hbase4.apache.org/42941] util.JVMClusterUtil(257): Found active master hash=863765738, stopped=false 2023-07-24 16:08:43,028 DEBUG [Listener at jenkins-hbase4.apache.org/42941] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:08:43,028 DEBUG [Listener at jenkins-hbase4.apache.org/42941] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 16:08:43,028 INFO [Listener at jenkins-hbase4.apache.org/42941] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,43489,1690214753588 2023-07-24 16:08:43,031 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 16:08:43,031 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 16:08:43,031 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 16:08:43,031 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 16:08:43,031 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 16:08:43,031 INFO [Listener at jenkins-hbase4.apache.org/42941] procedure2.ProcedureExecutor(629): Stopping 2023-07-24 16:08:43,031 DEBUG [Listener at jenkins-hbase4.apache.org/42941] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ee720ca to 127.0.0.1:49766 2023-07-24 16:08:43,032 DEBUG [Listener at jenkins-hbase4.apache.org/42941] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:08:43,032 INFO [Listener at jenkins-hbase4.apache.org/42941] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33053,1690214755222' ***** 2023-07-24 16:08:43,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 16:08:43,032 DEBUG [Listener at jenkins-hbase4.apache.org/42941] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:08:43,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 16:08:43,032 INFO [Listener at jenkins-hbase4.apache.org/42941] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 16:08:43,033 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 16:08:43,033 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 16:08:43,033 INFO [RS:0;jenkins-hbase4:33053] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 16:08:43,033 INFO [RS:0;jenkins-hbase4:33053] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 16:08:43,033 INFO [RS:0;jenkins-hbase4:33053] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 16:08:43,033 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 16:08:43,034 INFO [RS:0;jenkins-hbase4:33053] regionserver.HRegionServer(3305): Received CLOSE for 9a519ef3c23975337d1ead4c50ddd583 2023-07-24 16:08:43,034 INFO [RS:0;jenkins-hbase4:33053] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:08:43,034 DEBUG [RS:0;jenkins-hbase4:33053] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x297f6a86 to 127.0.0.1:49766 2023-07-24 16:08:43,034 DEBUG [RS:0;jenkins-hbase4:33053] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:08:43,033 INFO [Listener at jenkins-hbase4.apache.org/42941] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,38047,1690214755282' ***** 2023-07-24 16:08:43,035 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9a519ef3c23975337d1ead4c50ddd583, disabling compactions & flushes 2023-07-24 16:08:43,040 DEBUG [Listener at jenkins-hbase4.apache.org/42941] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:08:43,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690214758149.9a519ef3c23975337d1ead4c50ddd583. 2023-07-24 16:08:43,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690214758149.9a519ef3c23975337d1ead4c50ddd583. 2023-07-24 16:08:43,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690214758149.9a519ef3c23975337d1ead4c50ddd583. after waiting 0 ms 2023-07-24 16:08:43,040 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690214758149.9a519ef3c23975337d1ead4c50ddd583. 2023-07-24 16:08:43,040 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 9a519ef3c23975337d1ead4c50ddd583 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-24 16:08:43,040 INFO [Listener at jenkins-hbase4.apache.org/42941] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 16:08:43,041 INFO [Listener at jenkins-hbase4.apache.org/42941] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33229,1690214755329' ***** 2023-07-24 16:08:43,041 DEBUG [Listener at jenkins-hbase4.apache.org/42941] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:08:43,041 INFO [Listener at jenkins-hbase4.apache.org/42941] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 16:08:43,041 INFO [RS:2;jenkins-hbase4:33229] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 16:08:43,042 INFO [RS:2;jenkins-hbase4:33229] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 16:08:43,042 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 16:08:43,042 INFO [RS:2;jenkins-hbase4:33229] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 16:08:43,042 INFO [RS:2;jenkins-hbase4:33229] regionserver.HRegionServer(3305): Received CLOSE for c835061443958a14d991915cd46995dd 2023-07-24 16:08:43,042 INFO [RS:2;jenkins-hbase4:33229] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:08:43,042 DEBUG [RS:2;jenkins-hbase4:33229] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1bbbc2ce to 127.0.0.1:49766 2023-07-24 16:08:43,042 DEBUG [RS:2;jenkins-hbase4:33229] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:08:43,053 INFO [RS:2;jenkins-hbase4:33229] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 16:08:43,053 INFO [RS:2;jenkins-hbase4:33229] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 16:08:43,053 INFO [RS:2;jenkins-hbase4:33229] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 16:08:43,053 INFO [RS:2;jenkins-hbase4:33229] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-24 16:08:43,053 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 16:08:43,053 INFO [RS:0;jenkins-hbase4:33053] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-24 16:08:43,054 DEBUG [RS:0;jenkins-hbase4:33053] regionserver.HRegionServer(1478): Online Regions={9a519ef3c23975337d1ead4c50ddd583=hbase:namespace,,1690214758149.9a519ef3c23975337d1ead4c50ddd583.} 2023-07-24 16:08:43,053 INFO [RS:1;jenkins-hbase4:38047] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 16:08:43,055 DEBUG [RS:0;jenkins-hbase4:33053] regionserver.HRegionServer(1504): Waiting on 9a519ef3c23975337d1ead4c50ddd583 2023-07-24 16:08:43,055 INFO [RS:2;jenkins-hbase4:33229] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-24 16:08:43,057 DEBUG [RS:2;jenkins-hbase4:33229] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, c835061443958a14d991915cd46995dd=hbase:acl,,1690214758906.c835061443958a14d991915cd46995dd.} 2023-07-24 16:08:43,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c835061443958a14d991915cd46995dd, disabling compactions & flushes 2023-07-24 16:08:43,058 INFO [RS:1;jenkins-hbase4:38047] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 16:08:43,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690214758906.c835061443958a14d991915cd46995dd. 2023-07-24 16:08:43,058 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 16:08:43,058 DEBUG [RS:2;jenkins-hbase4:33229] regionserver.HRegionServer(1504): Waiting on 1588230740, c835061443958a14d991915cd46995dd 2023-07-24 16:08:43,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690214758906.c835061443958a14d991915cd46995dd. 2023-07-24 16:08:43,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690214758906.c835061443958a14d991915cd46995dd. after waiting 0 ms 2023-07-24 16:08:43,058 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690214758906.c835061443958a14d991915cd46995dd. 2023-07-24 16:08:43,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c835061443958a14d991915cd46995dd 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-24 16:08:43,058 INFO [RS:1;jenkins-hbase4:38047] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 16:08:43,058 INFO [RS:1;jenkins-hbase4:38047] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:08:43,059 DEBUG [RS:1;jenkins-hbase4:38047] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76862469 to 127.0.0.1:49766 2023-07-24 16:08:43,059 DEBUG [RS:1;jenkins-hbase4:38047] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:08:43,059 INFO [RS:1;jenkins-hbase4:38047] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,38047,1690214755282; all regions closed. 2023-07-24 16:08:43,065 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-24 16:08:43,065 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-24 16:08:43,065 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-24 16:08:43,065 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-24 16:08:43,065 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-24 16:08:43,065 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-24 16:08:43,133 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 16:08:43,133 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 16:08:43,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/namespace/9a519ef3c23975337d1ead4c50ddd583/.tmp/info/018269cf24a24d7b87f374a662befe2a 2023-07-24 16:08:43,148 DEBUG [RS:1;jenkins-hbase4:38047] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/oldWALs 2023-07-24 16:08:43,148 INFO [RS:1;jenkins-hbase4:38047] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38047%2C1690214755282:(num 1690214757620) 2023-07-24 16:08:43,148 DEBUG [RS:1;jenkins-hbase4:38047] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:08:43,148 INFO [RS:1;jenkins-hbase4:38047] regionserver.LeaseManager(133): Closed leases 2023-07-24 16:08:43,155 INFO [RS:1;jenkins-hbase4:38047] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-24 16:08:43,155 INFO [RS:1;jenkins-hbase4:38047] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 16:08:43,155 INFO [RS:1;jenkins-hbase4:38047] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 16:08:43,155 INFO [RS:1;jenkins-hbase4:38047] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 16:08:43,156 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 16:08:43,164 INFO [RS:1;jenkins-hbase4:38047] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38047 2023-07-24 16:08:43,172 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:08:43,172 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:08:43,172 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38047,1690214755282 2023-07-24 16:08:43,172 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 16:08:43,172 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 16:08:43,172 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 16:08:43,172 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 16:08:43,175 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38047,1690214755282] 2023-07-24 16:08:43,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/namespace/9a519ef3c23975337d1ead4c50ddd583/.tmp/info/018269cf24a24d7b87f374a662befe2a as hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/namespace/9a519ef3c23975337d1ead4c50ddd583/info/018269cf24a24d7b87f374a662befe2a 2023-07-24 16:08:43,177 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740/.tmp/info/d72406362f454aecb63b778c85c7ed0d 2023-07-24 16:08:43,182 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/namespace/9a519ef3c23975337d1ead4c50ddd583/info/018269cf24a24d7b87f374a662befe2a, entries=2, sequenceid=6, filesize=4.8 K 2023-07-24 16:08:43,183 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 9a519ef3c23975337d1ead4c50ddd583 in 143ms, sequenceid=6, compaction requested=false 2023-07-24 16:08:43,190 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38047,1690214755282; numProcessing=1 2023-07-24 16:08:43,197 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/acl/c835061443958a14d991915cd46995dd/.tmp/l/7ca9221d621d417891bdffa527ce4551 2023-07-24 16:08:43,199 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d72406362f454aecb63b778c85c7ed0d 2023-07-24 16:08:43,202 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/namespace/9a519ef3c23975337d1ead4c50ddd583/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 16:08:43,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:08:43,204 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690214758149.9a519ef3c23975337d1ead4c50ddd583. 2023-07-24 16:08:43,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7ca9221d621d417891bdffa527ce4551 2023-07-24 16:08:43,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9a519ef3c23975337d1ead4c50ddd583: 2023-07-24 16:08:43,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690214758149.9a519ef3c23975337d1ead4c50ddd583. 2023-07-24 16:08:43,207 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/acl/c835061443958a14d991915cd46995dd/.tmp/l/7ca9221d621d417891bdffa527ce4551 as hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/acl/c835061443958a14d991915cd46995dd/l/7ca9221d621d417891bdffa527ce4551 2023-07-24 16:08:43,213 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7ca9221d621d417891bdffa527ce4551 2023-07-24 16:08:43,213 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/acl/c835061443958a14d991915cd46995dd/l/7ca9221d621d417891bdffa527ce4551, entries=7, sequenceid=18, filesize=5.2 K 2023-07-24 16:08:43,215 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for c835061443958a14d991915cd46995dd in 157ms, sequenceid=18, compaction requested=false 2023-07-24 16:08:43,229 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740/.tmp/rep_barrier/9a55c26c640944248fe7cd3bf1b27f6a 2023-07-24 16:08:43,237 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9a55c26c640944248fe7cd3bf1b27f6a 2023-07-24 16:08:43,254 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/acl/c835061443958a14d991915cd46995dd/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-24 16:08:43,255 INFO [RS:0;jenkins-hbase4:33053] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33053,1690214755222; all regions closed. 2023-07-24 16:08:43,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:08:43,258 DEBUG [RS:2;jenkins-hbase4:33229] regionserver.HRegionServer(1504): Waiting on 1588230740, c835061443958a14d991915cd46995dd 2023-07-24 16:08:43,263 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1690214758906.c835061443958a14d991915cd46995dd. 2023-07-24 16:08:43,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c835061443958a14d991915cd46995dd: 2023-07-24 16:08:43,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1690214758906.c835061443958a14d991915cd46995dd. 2023-07-24 16:08:43,275 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 16:08:43,275 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:38047-0x1019814e4520002, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 16:08:43,275 INFO [RS:1;jenkins-hbase4:38047] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,38047,1690214755282; zookeeper connection closed. 2023-07-24 16:08:43,276 DEBUG [RS:0;jenkins-hbase4:33053] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/oldWALs 2023-07-24 16:08:43,276 INFO [RS:0;jenkins-hbase4:33053] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33053%2C1690214755222:(num 1690214757620) 2023-07-24 16:08:43,277 DEBUG [RS:0;jenkins-hbase4:33053] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:08:43,277 INFO [RS:0;jenkins-hbase4:33053] regionserver.LeaseManager(133): Closed leases 2023-07-24 16:08:43,278 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38047,1690214755282 already deleted, retry=false 2023-07-24 16:08:43,278 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,38047,1690214755282 expired; onlineServers=2 2023-07-24 16:08:43,284 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@210d9cd8] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@210d9cd8 2023-07-24 16:08:43,284 INFO [RS:0;jenkins-hbase4:33053] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-24 16:08:43,285 INFO [RS:0;jenkins-hbase4:33053] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 16:08:43,285 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 16:08:43,285 INFO [RS:0;jenkins-hbase4:33053] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 16:08:43,285 INFO [RS:0;jenkins-hbase4:33053] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 16:08:43,286 INFO [RS:0;jenkins-hbase4:33053] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33053 2023-07-24 16:08:43,288 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:08:43,288 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33053,1690214755222 2023-07-24 16:08:43,288 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 16:08:43,290 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33053,1690214755222] 2023-07-24 16:08:43,290 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33053,1690214755222; numProcessing=2 2023-07-24 16:08:43,292 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33053,1690214755222 already deleted, retry=false 2023-07-24 16:08:43,292 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33053,1690214755222 expired; onlineServers=1 2023-07-24 16:08:43,295 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740/.tmp/table/2dcd62a30edb4325859db3d6df8be170 2023-07-24 16:08:43,299 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2dcd62a30edb4325859db3d6df8be170 2023-07-24 16:08:43,300 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740/.tmp/info/d72406362f454aecb63b778c85c7ed0d as hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740/info/d72406362f454aecb63b778c85c7ed0d 2023-07-24 16:08:43,306 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d72406362f454aecb63b778c85c7ed0d 2023-07-24 16:08:43,306 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740/info/d72406362f454aecb63b778c85c7ed0d, entries=48, sequenceid=131, filesize=10.3 K 2023-07-24 16:08:43,307 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740/.tmp/rep_barrier/9a55c26c640944248fe7cd3bf1b27f6a as hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740/rep_barrier/9a55c26c640944248fe7cd3bf1b27f6a 2023-07-24 16:08:43,312 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9a55c26c640944248fe7cd3bf1b27f6a 2023-07-24 16:08:43,313 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740/rep_barrier/9a55c26c640944248fe7cd3bf1b27f6a, entries=13, sequenceid=131, filesize=6.4 K 2023-07-24 16:08:43,314 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740/.tmp/table/2dcd62a30edb4325859db3d6df8be170 as hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740/table/2dcd62a30edb4325859db3d6df8be170 2023-07-24 16:08:43,320 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2dcd62a30edb4325859db3d6df8be170 2023-07-24 16:08:43,320 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740/table/2dcd62a30edb4325859db3d6df8be170, entries=24, sequenceid=131, filesize=6.9 K 2023-07-24 16:08:43,322 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 257ms, sequenceid=131, compaction requested=false 2023-07-24 16:08:43,342 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-24 16:08:43,344 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:08:43,344 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 16:08:43,345 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-24 16:08:43,345 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-24 16:08:43,345 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-24 16:08:43,390 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 16:08:43,390 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33053-0x1019814e4520001, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 16:08:43,390 INFO [RS:0;jenkins-hbase4:33053] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33053,1690214755222; zookeeper connection closed. 2023-07-24 16:08:43,391 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7e02a9af] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7e02a9af 2023-07-24 16:08:43,395 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-24 16:08:43,395 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-24 16:08:43,458 INFO [RS:2;jenkins-hbase4:33229] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33229,1690214755329; all regions closed. 2023-07-24 16:08:43,475 DEBUG [RS:2;jenkins-hbase4:33229] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/oldWALs 2023-07-24 16:08:43,475 INFO [RS:2;jenkins-hbase4:33229] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33229%2C1690214755329.meta:.meta(num 1690214757783) 2023-07-24 16:08:43,480 DEBUG [RS:2;jenkins-hbase4:33229] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/oldWALs 2023-07-24 16:08:43,480 INFO [RS:2;jenkins-hbase4:33229] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33229%2C1690214755329:(num 1690214757620) 2023-07-24 16:08:43,480 DEBUG [RS:2;jenkins-hbase4:33229] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:08:43,480 INFO [RS:2;jenkins-hbase4:33229] regionserver.LeaseManager(133): Closed leases 2023-07-24 16:08:43,481 INFO [RS:2;jenkins-hbase4:33229] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-24 16:08:43,481 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 16:08:43,482 INFO [RS:2;jenkins-hbase4:33229] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33229 2023-07-24 16:08:43,484 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33229,1690214755329 2023-07-24 16:08:43,484 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 16:08:43,485 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33229,1690214755329] 2023-07-24 16:08:43,485 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33229,1690214755329; numProcessing=3 2023-07-24 16:08:43,487 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33229,1690214755329 already deleted, retry=false 2023-07-24 16:08:43,487 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33229,1690214755329 expired; onlineServers=0 2023-07-24 16:08:43,487 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43489,1690214753588' ***** 2023-07-24 16:08:43,487 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-24 16:08:43,487 DEBUG [M:0;jenkins-hbase4:43489] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72410ed1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 16:08:43,487 INFO [M:0;jenkins-hbase4:43489] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43489,1690214753588 2023-07-24 16:08:43,487 INFO [M:0;jenkins-hbase4:43489] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43489,1690214753588; all regions closed. 2023-07-24 16:08:43,487 DEBUG [M:0;jenkins-hbase4:43489] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 16:08:43,487 DEBUG [M:0;jenkins-hbase4:43489] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-24 16:08:43,487 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-24 16:08:43,487 DEBUG [M:0;jenkins-hbase4:43489] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-24 16:08:43,487 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690214757062] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690214757062,5,FailOnTimeoutGroup] 2023-07-24 16:08:43,487 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690214757054] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690214757054,5,FailOnTimeoutGroup] 2023-07-24 16:08:43,488 INFO [M:0;jenkins-hbase4:43489] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-24 16:08:43,488 INFO [M:0;jenkins-hbase4:43489] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-24 16:08:43,488 INFO [M:0;jenkins-hbase4:43489] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-24 16:08:43,488 DEBUG [M:0;jenkins-hbase4:43489] master.HMaster(1512): Stopping service threads 2023-07-24 16:08:43,488 INFO [M:0;jenkins-hbase4:43489] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-24 16:08:43,488 ERROR [M:0;jenkins-hbase4:43489] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-24 16:08:43,488 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-24 16:08:43,488 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 16:08:43,489 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 16:08:43,489 INFO [M:0;jenkins-hbase4:43489] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-24 16:08:43,489 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-24 16:08:43,489 DEBUG [M:0;jenkins-hbase4:43489] zookeeper.ZKUtil(398): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-24 16:08:43,489 WARN [M:0;jenkins-hbase4:43489] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-24 16:08:43,489 INFO [M:0;jenkins-hbase4:43489] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-24 16:08:43,489 INFO [M:0;jenkins-hbase4:43489] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-24 16:08:43,490 DEBUG [M:0;jenkins-hbase4:43489] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-24 16:08:43,490 INFO [M:0;jenkins-hbase4:43489] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 16:08:43,490 DEBUG [M:0;jenkins-hbase4:43489] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 16:08:43,490 DEBUG [M:0;jenkins-hbase4:43489] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-24 16:08:43,490 DEBUG [M:0;jenkins-hbase4:43489] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 16:08:43,490 INFO [M:0;jenkins-hbase4:43489] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.71 KB heapSize=451.99 KB 2023-07-24 16:08:43,516 INFO [M:0;jenkins-hbase4:43489] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.71 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d9fa9cebf8384fd7b109440f21d6dc54 2023-07-24 16:08:43,522 INFO [M:0;jenkins-hbase4:43489] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d9fa9cebf8384fd7b109440f21d6dc54 2023-07-24 16:08:43,522 DEBUG [M:0;jenkins-hbase4:43489] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/d9fa9cebf8384fd7b109440f21d6dc54 as hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d9fa9cebf8384fd7b109440f21d6dc54 2023-07-24 16:08:43,527 INFO [M:0;jenkins-hbase4:43489] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d9fa9cebf8384fd7b109440f21d6dc54 2023-07-24 16:08:43,527 INFO [M:0;jenkins-hbase4:43489] regionserver.HStore(1080): Added hdfs://localhost:32943/user/jenkins/test-data/8f43cdbb-7d72-b27b-6e7d-844eb7b50ac0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/d9fa9cebf8384fd7b109440f21d6dc54, entries=119, sequenceid=899, filesize=28.6 K 2023-07-24 16:08:43,528 INFO [M:0;jenkins-hbase4:43489] regionserver.HRegion(2948): Finished flush of dataSize ~375.71 KB/384729, heapSize ~451.98 KB/462824, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 38ms, sequenceid=899, compaction requested=false 2023-07-24 16:08:43,530 INFO [M:0;jenkins-hbase4:43489] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 16:08:43,530 DEBUG [M:0;jenkins-hbase4:43489] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 16:08:43,537 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 16:08:43,537 INFO [M:0;jenkins-hbase4:43489] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-24 16:08:43,537 INFO [M:0;jenkins-hbase4:43489] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43489 2023-07-24 16:08:43,540 DEBUG [M:0;jenkins-hbase4:43489] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,43489,1690214753588 already deleted, retry=false 2023-07-24 16:08:43,586 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 16:08:43,586 INFO [RS:2;jenkins-hbase4:33229] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33229,1690214755329; zookeeper connection closed. 2023-07-24 16:08:43,586 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): regionserver:33229-0x1019814e4520003, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 16:08:43,586 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@a41a4f4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@a41a4f4 2023-07-24 16:08:43,586 INFO [Listener at jenkins-hbase4.apache.org/42941] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-24 16:08:43,686 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 16:08:43,686 INFO [M:0;jenkins-hbase4:43489] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43489,1690214753588; zookeeper connection closed. 2023-07-24 16:08:43,686 DEBUG [Listener at localhost/34603-EventThread] zookeeper.ZKWatcher(600): master:43489-0x1019814e4520000, quorum=127.0.0.1:49766, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 16:08:43,688 WARN [Listener at jenkins-hbase4.apache.org/42941] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 16:08:43,692 INFO [Listener at jenkins-hbase4.apache.org/42941] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 16:08:43,696 WARN [BP-1632011125-172.31.14.131-1690214749043 heartbeating to localhost/127.0.0.1:32943] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 16:08:43,696 WARN [BP-1632011125-172.31.14.131-1690214749043 heartbeating to localhost/127.0.0.1:32943] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1632011125-172.31.14.131-1690214749043 (Datanode Uuid 1fdb8e1b-1e91-4251-a6bf-be452c270217) service to localhost/127.0.0.1:32943 2023-07-24 16:08:43,698 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/cluster_b8887cf5-a132-099c-754f-127401d6508d/dfs/data/data5/current/BP-1632011125-172.31.14.131-1690214749043] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 16:08:43,699 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/cluster_b8887cf5-a132-099c-754f-127401d6508d/dfs/data/data6/current/BP-1632011125-172.31.14.131-1690214749043] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 16:08:43,700 WARN [Listener at jenkins-hbase4.apache.org/42941] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 16:08:43,705 INFO [Listener at jenkins-hbase4.apache.org/42941] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 16:08:43,784 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:08:43,784 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 16:08:43,784 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:08:43,784 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 16:08:43,784 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 16:08:43,809 WARN [BP-1632011125-172.31.14.131-1690214749043 heartbeating to localhost/127.0.0.1:32943] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 16:08:43,809 WARN [BP-1632011125-172.31.14.131-1690214749043 heartbeating to localhost/127.0.0.1:32943] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1632011125-172.31.14.131-1690214749043 (Datanode Uuid 271caa12-d49f-4a14-ba62-4ce050b414e0) service to localhost/127.0.0.1:32943 2023-07-24 16:08:43,810 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/cluster_b8887cf5-a132-099c-754f-127401d6508d/dfs/data/data3/current/BP-1632011125-172.31.14.131-1690214749043] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 16:08:43,811 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/cluster_b8887cf5-a132-099c-754f-127401d6508d/dfs/data/data4/current/BP-1632011125-172.31.14.131-1690214749043] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 16:08:43,812 WARN [Listener at jenkins-hbase4.apache.org/42941] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 16:08:43,820 INFO [Listener at jenkins-hbase4.apache.org/42941] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 16:08:43,924 WARN [BP-1632011125-172.31.14.131-1690214749043 heartbeating to localhost/127.0.0.1:32943] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 16:08:43,924 WARN [BP-1632011125-172.31.14.131-1690214749043 heartbeating to localhost/127.0.0.1:32943] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1632011125-172.31.14.131-1690214749043 (Datanode Uuid 9d959e46-5f9c-42f7-8ae7-8c931c1d82da) service to localhost/127.0.0.1:32943 2023-07-24 16:08:43,925 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/cluster_b8887cf5-a132-099c-754f-127401d6508d/dfs/data/data1/current/BP-1632011125-172.31.14.131-1690214749043] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 16:08:43,925 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/cb27989e-bdc7-bd5c-6c6e-0f193dcdc324/cluster_b8887cf5-a132-099c-754f-127401d6508d/dfs/data/data2/current/BP-1632011125-172.31.14.131-1690214749043] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 16:08:43,955 INFO [Listener at jenkins-hbase4.apache.org/42941] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 16:08:44,090 INFO [Listener at jenkins-hbase4.apache.org/42941] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-24 16:08:44,235 INFO [Listener at jenkins-hbase4.apache.org/42941] hbase.HBaseTestingUtility(1293): Minicluster is down