2023-07-14 11:12:15,176 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-14 11:12:15,436 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71 2023-07-14 11:12:15,436 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-14 11:12:15,476 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-14 11:12:15,720 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-14 11:12:15,721 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/cluster_2a4290d5-6584-4b86-320b-63166dfccd9d, deleteOnExit=true 2023-07-14 11:12:15,721 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-14 11:12:15,722 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/test.cache.data in system properties and HBase conf 2023-07-14 11:12:15,723 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/hadoop.tmp.dir in system properties and HBase conf 2023-07-14 11:12:15,723 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/hadoop.log.dir in system properties and HBase conf 2023-07-14 11:12:15,724 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-14 11:12:15,724 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-14 11:12:15,724 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-14 11:12:16,038 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-14 11:12:16,044 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-14 11:12:16,044 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-14 11:12:16,044 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-14 11:12:16,045 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 11:12:16,045 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-14 11:12:16,046 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-14 11:12:16,046 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 11:12:16,047 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 11:12:16,047 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-14 11:12:16,048 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/nfs.dump.dir in system properties and HBase conf 2023-07-14 11:12:16,048 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/java.io.tmpdir in system properties and HBase conf 2023-07-14 11:12:16,048 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 11:12:16,049 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-14 11:12:16,049 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-14 11:12:16,690 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-14 11:12:16,694 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-14 11:12:16,972 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-14 11:12:17,164 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-14 11:12:17,183 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 11:12:17,228 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 11:12:17,263 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/java.io.tmpdir/Jetty_localhost_45677_hdfs____2utr3/webapp 2023-07-14 11:12:17,407 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45677 2023-07-14 11:12:17,438 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-14 11:12:17,439 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-14 11:12:18,001 WARN [Listener at localhost/36847] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 11:12:18,091 WARN [Listener at localhost/36847] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 11:12:18,110 WARN [Listener at localhost/36847] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 11:12:18,117 INFO [Listener at localhost/36847] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 11:12:18,123 INFO [Listener at localhost/36847] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/java.io.tmpdir/Jetty_localhost_34795_datanode____vzz4ah/webapp 2023-07-14 11:12:18,232 INFO [Listener at localhost/36847] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34795 2023-07-14 11:12:18,798 WARN [Listener at localhost/35707] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 11:12:18,841 WARN [Listener at localhost/35707] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 11:12:18,846 WARN [Listener at localhost/35707] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 11:12:18,848 INFO [Listener at localhost/35707] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 11:12:18,856 INFO [Listener at localhost/35707] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/java.io.tmpdir/Jetty_localhost_46497_datanode____o0urnb/webapp 2023-07-14 11:12:18,985 INFO [Listener at localhost/35707] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46497 2023-07-14 11:12:19,005 WARN [Listener at localhost/39125] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 11:12:19,066 WARN [Listener at localhost/39125] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-14 11:12:19,069 WARN [Listener at localhost/39125] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 11:12:19,071 INFO [Listener at localhost/39125] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 11:12:19,079 INFO [Listener at localhost/39125] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/java.io.tmpdir/Jetty_localhost_43169_datanode____.a2bjd0/webapp 2023-07-14 11:12:19,249 INFO [Listener at localhost/39125] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43169 2023-07-14 11:12:19,277 WARN [Listener at localhost/39195] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-14 11:12:19,522 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf28745b10813b8a1: Processing first storage report for DS-9e91bd05-d5ac-45de-bebd-4f24d0a952ff from datanode f1551f54-5779-4f53-8d7f-224403ad4922 2023-07-14 11:12:19,524 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf28745b10813b8a1: from storage DS-9e91bd05-d5ac-45de-bebd-4f24d0a952ff node DatanodeRegistration(127.0.0.1:33489, datanodeUuid=f1551f54-5779-4f53-8d7f-224403ad4922, infoPort=44741, infoSecurePort=0, ipcPort=35707, storageInfo=lv=-57;cid=testClusterID;nsid=857469947;c=1689333136763), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-14 11:12:19,524 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf14cb44cf75a0f14: Processing first storage report for DS-cf8f7062-492e-484c-a42b-e87ac240e2d7 from datanode bfbda527-4076-464f-9c99-e51a02fba6f4 2023-07-14 11:12:19,524 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf14cb44cf75a0f14: from storage DS-cf8f7062-492e-484c-a42b-e87ac240e2d7 node DatanodeRegistration(127.0.0.1:46299, datanodeUuid=bfbda527-4076-464f-9c99-e51a02fba6f4, infoPort=40687, infoSecurePort=0, ipcPort=39125, storageInfo=lv=-57;cid=testClusterID;nsid=857469947;c=1689333136763), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 11:12:19,524 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf28745b10813b8a1: Processing first storage report for DS-4f18348e-86e5-4cb5-95ed-2c04e297ee4a from datanode f1551f54-5779-4f53-8d7f-224403ad4922 2023-07-14 11:12:19,525 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf28745b10813b8a1: from storage DS-4f18348e-86e5-4cb5-95ed-2c04e297ee4a node DatanodeRegistration(127.0.0.1:33489, datanodeUuid=f1551f54-5779-4f53-8d7f-224403ad4922, infoPort=44741, infoSecurePort=0, ipcPort=35707, storageInfo=lv=-57;cid=testClusterID;nsid=857469947;c=1689333136763), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 11:12:19,525 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf14cb44cf75a0f14: Processing first storage report for DS-69d355fd-f4d0-40d3-947a-cc5421d4f92d from datanode bfbda527-4076-464f-9c99-e51a02fba6f4 2023-07-14 11:12:19,525 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf14cb44cf75a0f14: from storage DS-69d355fd-f4d0-40d3-947a-cc5421d4f92d node DatanodeRegistration(127.0.0.1:46299, datanodeUuid=bfbda527-4076-464f-9c99-e51a02fba6f4, infoPort=40687, infoSecurePort=0, ipcPort=39125, storageInfo=lv=-57;cid=testClusterID;nsid=857469947;c=1689333136763), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 11:12:19,537 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xec3fd6e2b19d95bf: Processing first storage report for DS-d4ee9d5c-c919-44fd-88b3-93882a3de5f2 from datanode d3f89d4c-16c2-4824-812b-6b7388609af1 2023-07-14 11:12:19,537 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xec3fd6e2b19d95bf: from storage DS-d4ee9d5c-c919-44fd-88b3-93882a3de5f2 node DatanodeRegistration(127.0.0.1:36163, datanodeUuid=d3f89d4c-16c2-4824-812b-6b7388609af1, infoPort=36175, infoSecurePort=0, ipcPort=39195, storageInfo=lv=-57;cid=testClusterID;nsid=857469947;c=1689333136763), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-14 11:12:19,537 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xec3fd6e2b19d95bf: Processing first storage report for DS-25467835-befa-439a-9bcc-60c4d49b94f5 from datanode d3f89d4c-16c2-4824-812b-6b7388609af1 2023-07-14 11:12:19,537 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xec3fd6e2b19d95bf: from storage DS-25467835-befa-439a-9bcc-60c4d49b94f5 node DatanodeRegistration(127.0.0.1:36163, datanodeUuid=d3f89d4c-16c2-4824-812b-6b7388609af1, infoPort=36175, infoSecurePort=0, ipcPort=39195, storageInfo=lv=-57;cid=testClusterID;nsid=857469947;c=1689333136763), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-14 11:12:19,754 DEBUG [Listener at localhost/39195] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71 2023-07-14 11:12:19,845 INFO [Listener at localhost/39195] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/cluster_2a4290d5-6584-4b86-320b-63166dfccd9d/zookeeper_0, clientPort=58300, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/cluster_2a4290d5-6584-4b86-320b-63166dfccd9d/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/cluster_2a4290d5-6584-4b86-320b-63166dfccd9d/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-14 11:12:19,866 INFO [Listener at localhost/39195] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58300 2023-07-14 11:12:19,882 INFO [Listener at localhost/39195] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 11:12:19,889 INFO [Listener at localhost/39195] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 11:12:20,571 INFO [Listener at localhost/39195] util.FSUtils(471): Created version file at hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4 with version=8 2023-07-14 11:12:20,572 INFO [Listener at localhost/39195] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/hbase-staging 2023-07-14 11:12:20,936 INFO [Listener at localhost/39195] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-14 11:12:21,603 INFO [Listener at localhost/39195] client.ConnectionUtils(127): master/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 11:12:21,647 INFO [Listener at localhost/39195] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 11:12:21,648 INFO [Listener at localhost/39195] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 11:12:21,648 INFO [Listener at localhost/39195] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 11:12:21,648 INFO [Listener at localhost/39195] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 11:12:21,649 INFO [Listener at localhost/39195] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 11:12:21,824 INFO [Listener at localhost/39195] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 11:12:21,928 DEBUG [Listener at localhost/39195] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-14 11:12:22,071 INFO [Listener at localhost/39195] ipc.NettyRpcServer(120): Bind to /172.31.2.10:38311 2023-07-14 11:12:22,090 INFO [Listener at localhost/39195] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 11:12:22,093 INFO [Listener at localhost/39195] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 11:12:22,116 INFO [Listener at localhost/39195] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38311 connecting to ZooKeeper ensemble=127.0.0.1:58300 2023-07-14 11:12:22,175 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:383110x0, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 11:12:22,179 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38311-0x101637acd0d0000 connected 2023-07-14 11:12:22,228 DEBUG [Listener at localhost/39195] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 11:12:22,229 DEBUG [Listener at localhost/39195] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 11:12:22,248 DEBUG [Listener at localhost/39195] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 11:12:22,264 DEBUG [Listener at localhost/39195] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38311 2023-07-14 11:12:22,267 DEBUG [Listener at localhost/39195] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38311 2023-07-14 11:12:22,269 DEBUG [Listener at localhost/39195] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38311 2023-07-14 11:12:22,271 DEBUG [Listener at localhost/39195] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38311 2023-07-14 11:12:22,272 DEBUG [Listener at localhost/39195] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38311 2023-07-14 11:12:22,280 INFO [Listener at localhost/39195] master.HMaster(444): hbase.rootdir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4, hbase.cluster.distributed=false 2023-07-14 11:12:22,354 INFO [Listener at localhost/39195] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 11:12:22,354 INFO [Listener at localhost/39195] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 11:12:22,354 INFO [Listener at localhost/39195] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 11:12:22,354 INFO [Listener at localhost/39195] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 11:12:22,355 INFO [Listener at localhost/39195] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 11:12:22,355 INFO [Listener at localhost/39195] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 11:12:22,361 INFO [Listener at localhost/39195] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 11:12:22,371 INFO [Listener at localhost/39195] ipc.NettyRpcServer(120): Bind to /172.31.2.10:46581 2023-07-14 11:12:22,377 INFO [Listener at localhost/39195] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 11:12:22,397 DEBUG [Listener at localhost/39195] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-14 11:12:22,399 INFO [Listener at localhost/39195] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 11:12:22,402 INFO [Listener at localhost/39195] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 11:12:22,404 INFO [Listener at localhost/39195] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46581 connecting to ZooKeeper ensemble=127.0.0.1:58300 2023-07-14 11:12:22,420 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:465810x0, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 11:12:22,426 DEBUG [Listener at localhost/39195] zookeeper.ZKUtil(164): regionserver:465810x0, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 11:12:22,431 DEBUG [Listener at localhost/39195] zookeeper.ZKUtil(164): regionserver:465810x0, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 11:12:22,431 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46581-0x101637acd0d0001 connected 2023-07-14 11:12:22,432 DEBUG [Listener at localhost/39195] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 11:12:22,437 DEBUG [Listener at localhost/39195] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46581 2023-07-14 11:12:22,437 DEBUG [Listener at localhost/39195] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46581 2023-07-14 11:12:22,450 DEBUG [Listener at localhost/39195] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46581 2023-07-14 11:12:22,457 DEBUG [Listener at localhost/39195] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46581 2023-07-14 11:12:22,470 DEBUG [Listener at localhost/39195] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46581 2023-07-14 11:12:22,491 INFO [Listener at localhost/39195] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 11:12:22,491 INFO [Listener at localhost/39195] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 11:12:22,491 INFO [Listener at localhost/39195] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 11:12:22,492 INFO [Listener at localhost/39195] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 11:12:22,492 INFO [Listener at localhost/39195] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 11:12:22,493 INFO [Listener at localhost/39195] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 11:12:22,493 INFO [Listener at localhost/39195] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 11:12:22,504 INFO [Listener at localhost/39195] ipc.NettyRpcServer(120): Bind to /172.31.2.10:35929 2023-07-14 11:12:22,505 INFO [Listener at localhost/39195] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 11:12:22,533 DEBUG [Listener at localhost/39195] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-14 11:12:22,535 INFO [Listener at localhost/39195] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 11:12:22,538 INFO [Listener at localhost/39195] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 11:12:22,549 INFO [Listener at localhost/39195] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35929 connecting to ZooKeeper ensemble=127.0.0.1:58300 2023-07-14 11:12:22,562 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:359290x0, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 11:12:22,564 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35929-0x101637acd0d0002 connected 2023-07-14 11:12:22,564 DEBUG [Listener at localhost/39195] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 11:12:22,565 DEBUG [Listener at localhost/39195] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 11:12:22,566 DEBUG [Listener at localhost/39195] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 11:12:22,585 DEBUG [Listener at localhost/39195] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35929 2023-07-14 11:12:22,589 DEBUG [Listener at localhost/39195] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35929 2023-07-14 11:12:22,594 DEBUG [Listener at localhost/39195] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35929 2023-07-14 11:12:22,598 DEBUG [Listener at localhost/39195] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35929 2023-07-14 11:12:22,599 DEBUG [Listener at localhost/39195] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35929 2023-07-14 11:12:22,617 INFO [Listener at localhost/39195] client.ConnectionUtils(127): regionserver/jenkins-hbase9:0 server-side Connection retries=45 2023-07-14 11:12:22,618 INFO [Listener at localhost/39195] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 11:12:22,618 INFO [Listener at localhost/39195] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-14 11:12:22,618 INFO [Listener at localhost/39195] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-14 11:12:22,618 INFO [Listener at localhost/39195] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-14 11:12:22,618 INFO [Listener at localhost/39195] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-14 11:12:22,619 INFO [Listener at localhost/39195] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-14 11:12:22,623 INFO [Listener at localhost/39195] ipc.NettyRpcServer(120): Bind to /172.31.2.10:40207 2023-07-14 11:12:22,624 INFO [Listener at localhost/39195] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-14 11:12:22,633 DEBUG [Listener at localhost/39195] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-14 11:12:22,635 INFO [Listener at localhost/39195] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 11:12:22,637 INFO [Listener at localhost/39195] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 11:12:22,638 INFO [Listener at localhost/39195] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40207 connecting to ZooKeeper ensemble=127.0.0.1:58300 2023-07-14 11:12:22,644 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:402070x0, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-14 11:12:22,646 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40207-0x101637acd0d0003 connected 2023-07-14 11:12:22,646 DEBUG [Listener at localhost/39195] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 11:12:22,647 DEBUG [Listener at localhost/39195] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 11:12:22,648 DEBUG [Listener at localhost/39195] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-14 11:12:22,648 DEBUG [Listener at localhost/39195] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40207 2023-07-14 11:12:22,651 DEBUG [Listener at localhost/39195] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40207 2023-07-14 11:12:22,652 DEBUG [Listener at localhost/39195] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40207 2023-07-14 11:12:22,659 DEBUG [Listener at localhost/39195] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40207 2023-07-14 11:12:22,661 DEBUG [Listener at localhost/39195] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40207 2023-07-14 11:12:22,683 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase9.apache.org,38311,1689333140751 2023-07-14 11:12:22,699 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-14 11:12:22,703 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase9.apache.org,38311,1689333140751 2023-07-14 11:12:22,740 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 11:12:22,740 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 11:12:22,740 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 11:12:22,740 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-14 11:12:22,741 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 11:12:22,745 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-14 11:12:22,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-14 11:12:22,748 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase9.apache.org,38311,1689333140751 from backup master directory 2023-07-14 11:12:22,753 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase9.apache.org,38311,1689333140751 2023-07-14 11:12:22,753 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-14 11:12:22,756 WARN [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 11:12:22,756 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase9.apache.org,38311,1689333140751 2023-07-14 11:12:22,760 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-14 11:12:22,771 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-14 11:12:22,915 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/hbase.id with ID: 51a6a296-ecbb-4616-89ea-09a53fc26613 2023-07-14 11:12:23,011 INFO [master/jenkins-hbase9:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-14 11:12:23,039 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 11:12:23,125 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x123ac060 to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:12:23,185 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a61a940, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:12:23,220 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 11:12:23,222 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-14 11:12:23,246 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-14 11:12:23,246 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-14 11:12:23,249 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-14 11:12:23,254 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-14 11:12:23,255 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 11:12:23,310 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/MasterData/data/master/store-tmp 2023-07-14 11:12:23,473 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:23,473 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-14 11:12:23,473 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 11:12:23,473 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 11:12:23,473 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-14 11:12:23,474 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 11:12:23,474 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 11:12:23,474 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 11:12:23,476 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/MasterData/WALs/jenkins-hbase9.apache.org,38311,1689333140751 2023-07-14 11:12:23,503 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C38311%2C1689333140751, suffix=, logDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/MasterData/WALs/jenkins-hbase9.apache.org,38311,1689333140751, archiveDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/MasterData/oldWALs, maxLogs=10 2023-07-14 11:12:23,601 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33489,DS-9e91bd05-d5ac-45de-bebd-4f24d0a952ff,DISK] 2023-07-14 11:12:23,601 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46299,DS-cf8f7062-492e-484c-a42b-e87ac240e2d7,DISK] 2023-07-14 11:12:23,612 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36163,DS-d4ee9d5c-c919-44fd-88b3-93882a3de5f2,DISK] 2023-07-14 11:12:23,636 DEBUG [RS-EventLoopGroup-5-1] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-14 11:12:23,746 INFO [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/MasterData/WALs/jenkins-hbase9.apache.org,38311,1689333140751/jenkins-hbase9.apache.org%2C38311%2C1689333140751.1689333143515 2023-07-14 11:12:23,760 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46299,DS-cf8f7062-492e-484c-a42b-e87ac240e2d7,DISK], DatanodeInfoWithStorage[127.0.0.1:36163,DS-d4ee9d5c-c919-44fd-88b3-93882a3de5f2,DISK], DatanodeInfoWithStorage[127.0.0.1:33489,DS-9e91bd05-d5ac-45de-bebd-4f24d0a952ff,DISK]] 2023-07-14 11:12:23,761 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-14 11:12:23,762 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:23,765 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 11:12:23,767 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 11:12:23,940 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-14 11:12:23,951 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-14 11:12:24,030 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-14 11:12:24,052 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:12:24,062 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-14 11:12:24,065 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-14 11:12:24,130 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-14 11:12:24,148 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:12:24,149 INFO [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63461462, jitterRate=-0.05435052514076233}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:12:24,150 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 11:12:24,151 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-14 11:12:24,185 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-14 11:12:24,185 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-14 11:12:24,189 INFO [master/jenkins-hbase9:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-14 11:12:24,194 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 4 msec 2023-07-14 11:12:24,250 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 55 msec 2023-07-14 11:12:24,250 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-14 11:12:24,296 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-14 11:12:24,303 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-14 11:12:24,329 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-14 11:12:24,335 INFO [master/jenkins-hbase9:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-14 11:12:24,338 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-14 11:12:24,346 INFO [master/jenkins-hbase9:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-14 11:12:24,350 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-14 11:12:24,356 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 11:12:24,357 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-14 11:12:24,358 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-14 11:12:24,372 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-14 11:12:24,377 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 11:12:24,377 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 11:12:24,377 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 11:12:24,377 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 11:12:24,377 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-14 11:12:24,390 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase9.apache.org,38311,1689333140751, sessionid=0x101637acd0d0000, setting cluster-up flag (Was=false) 2023-07-14 11:12:24,413 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 11:12:24,420 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-14 11:12:24,422 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,38311,1689333140751 2023-07-14 11:12:24,432 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 11:12:24,441 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-14 11:12:24,443 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase9.apache.org,38311,1689333140751 2023-07-14 11:12:24,446 WARN [master/jenkins-hbase9:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp 2023-07-14 11:12:24,474 INFO [RS:1;jenkins-hbase9:35929] regionserver.HRegionServer(951): ClusterId : 51a6a296-ecbb-4616-89ea-09a53fc26613 2023-07-14 11:12:24,475 INFO [RS:2;jenkins-hbase9:40207] regionserver.HRegionServer(951): ClusterId : 51a6a296-ecbb-4616-89ea-09a53fc26613 2023-07-14 11:12:24,476 INFO [RS:0;jenkins-hbase9:46581] regionserver.HRegionServer(951): ClusterId : 51a6a296-ecbb-4616-89ea-09a53fc26613 2023-07-14 11:12:24,485 DEBUG [RS:0;jenkins-hbase9:46581] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 11:12:24,485 DEBUG [RS:1;jenkins-hbase9:35929] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 11:12:24,493 DEBUG [RS:2;jenkins-hbase9:40207] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-14 11:12:24,503 DEBUG [RS:1;jenkins-hbase9:35929] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 11:12:24,503 DEBUG [RS:1;jenkins-hbase9:35929] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 11:12:24,503 DEBUG [RS:0;jenkins-hbase9:46581] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 11:12:24,503 DEBUG [RS:2;jenkins-hbase9:40207] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-14 11:12:24,503 DEBUG [RS:0;jenkins-hbase9:46581] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 11:12:24,503 DEBUG [RS:2;jenkins-hbase9:40207] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-14 11:12:24,511 DEBUG [RS:2;jenkins-hbase9:40207] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 11:12:24,512 DEBUG [RS:0;jenkins-hbase9:46581] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 11:12:24,524 DEBUG [RS:2;jenkins-hbase9:40207] zookeeper.ReadOnlyZKClient(139): Connect 0x7a7017fe to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:12:24,524 DEBUG [RS:0;jenkins-hbase9:46581] zookeeper.ReadOnlyZKClient(139): Connect 0x141da82b to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:12:24,526 DEBUG [RS:1;jenkins-hbase9:35929] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-14 11:12:24,598 DEBUG [RS:1;jenkins-hbase9:35929] zookeeper.ReadOnlyZKClient(139): Connect 0x730956d2 to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:12:24,641 DEBUG [RS:0;jenkins-hbase9:46581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1db16821, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:12:24,661 DEBUG [RS:0;jenkins-hbase9:46581] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72cacd3c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 11:12:24,663 DEBUG [RS:2;jenkins-hbase9:40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f7286d4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:12:24,664 DEBUG [RS:2;jenkins-hbase9:40207] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c2df1b8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 11:12:24,676 DEBUG [RS:1;jenkins-hbase9:35929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@15acd1bb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:12:24,676 DEBUG [RS:1;jenkins-hbase9:35929] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3813a766, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 11:12:24,700 DEBUG [RS:1;jenkins-hbase9:35929] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase9:35929 2023-07-14 11:12:24,718 DEBUG [RS:0;jenkins-hbase9:46581] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase9:46581 2023-07-14 11:12:24,709 DEBUG [RS:2;jenkins-hbase9:40207] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase9:40207 2023-07-14 11:12:24,723 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-14 11:12:24,723 INFO [RS:2;jenkins-hbase9:40207] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 11:12:24,723 INFO [RS:2;jenkins-hbase9:40207] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 11:12:24,726 INFO [RS:0;jenkins-hbase9:46581] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 11:12:24,727 INFO [RS:0;jenkins-hbase9:46581] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 11:12:24,728 DEBUG [RS:0;jenkins-hbase9:46581] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 11:12:24,730 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:12:24,730 INFO [master/jenkins-hbase9:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-14 11:12:24,731 DEBUG [RS:2;jenkins-hbase9:40207] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 11:12:24,724 INFO [RS:1;jenkins-hbase9:35929] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-14 11:12:24,742 INFO [RS:1;jenkins-hbase9:35929] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-14 11:12:24,732 INFO [RS:2;jenkins-hbase9:40207] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:12:24,732 INFO [RS:0;jenkins-hbase9:46581] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:12:24,742 DEBUG [RS:0;jenkins-hbase9:46581] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 11:12:24,742 DEBUG [RS:2;jenkins-hbase9:40207] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 11:12:24,742 DEBUG [RS:1;jenkins-hbase9:35929] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-14 11:12:24,745 INFO [RS:1;jenkins-hbase9:35929] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:12:24,745 DEBUG [RS:1;jenkins-hbase9:35929] regionserver.HRegionServer(1022): About to register with Master. 2023-07-14 11:12:24,747 INFO [RS:0;jenkins-hbase9:46581] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,38311,1689333140751 with isa=jenkins-hbase9.apache.org/172.31.2.10:46581, startcode=1689333142353 2023-07-14 11:12:24,747 INFO [RS:2;jenkins-hbase9:40207] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,38311,1689333140751 with isa=jenkins-hbase9.apache.org/172.31.2.10:40207, startcode=1689333142617 2023-07-14 11:12:24,747 INFO [RS:1;jenkins-hbase9:35929] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,38311,1689333140751 with isa=jenkins-hbase9.apache.org/172.31.2.10:35929, startcode=1689333142490 2023-07-14 11:12:24,793 DEBUG [RS:0;jenkins-hbase9:46581] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 11:12:24,811 DEBUG [RS:1;jenkins-hbase9:35929] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 11:12:24,793 DEBUG [RS:2;jenkins-hbase9:40207] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-14 11:12:24,909 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-14 11:12:24,914 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49567, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 11:12:24,914 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:32923, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 11:12:24,914 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55911, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-14 11:12:24,927 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38311] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 11:12:24,937 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 11:12:24,937 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 11:12:24,938 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 11:12:24,938 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=5, maxPoolSize=5 2023-07-14 11:12:24,938 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase9:0, corePoolSize=10, maxPoolSize=10 2023-07-14 11:12:24,938 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:24,938 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 11:12:24,938 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:24,939 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38311] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 11:12:24,940 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38311] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-14 11:12:24,946 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689333174946 2023-07-14 11:12:24,949 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-14 11:12:24,964 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-14 11:12:24,965 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-14 11:12:24,966 INFO [PEWorker-2] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-14 11:12:24,972 INFO [PEWorker-2] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 11:12:24,973 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-14 11:12:24,974 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-14 11:12:24,975 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-14 11:12:24,975 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-14 11:12:24,981 DEBUG [RS:0;jenkins-hbase9:46581] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 11:12:24,986 DEBUG [RS:1;jenkins-hbase9:35929] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 11:12:24,986 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:24,986 DEBUG [RS:2;jenkins-hbase9:40207] regionserver.HRegionServer(2830): Master is not running yet 2023-07-14 11:12:24,986 WARN [RS:0;jenkins-hbase9:46581] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-14 11:12:24,986 WARN [RS:1;jenkins-hbase9:35929] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-14 11:12:24,987 WARN [RS:2;jenkins-hbase9:40207] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-14 11:12:24,998 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-14 11:12:25,000 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-14 11:12:25,001 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-14 11:12:25,010 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-14 11:12:25,011 INFO [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-14 11:12:25,013 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689333145013,5,FailOnTimeoutGroup] 2023-07-14 11:12:25,013 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689333145013,5,FailOnTimeoutGroup] 2023-07-14 11:12:25,013 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,021 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-14 11:12:25,026 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,026 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,076 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-14 11:12:25,078 INFO [PEWorker-2] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-14 11:12:25,079 INFO [PEWorker-2] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4 2023-07-14 11:12:25,089 INFO [RS:2;jenkins-hbase9:40207] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,38311,1689333140751 with isa=jenkins-hbase9.apache.org/172.31.2.10:40207, startcode=1689333142617 2023-07-14 11:12:25,089 INFO [RS:0;jenkins-hbase9:46581] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,38311,1689333140751 with isa=jenkins-hbase9.apache.org/172.31.2.10:46581, startcode=1689333142353 2023-07-14 11:12:25,091 INFO [RS:1;jenkins-hbase9:35929] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase9.apache.org,38311,1689333140751 with isa=jenkins-hbase9.apache.org/172.31.2.10:35929, startcode=1689333142490 2023-07-14 11:12:25,099 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38311] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:25,105 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38311] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:25,106 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38311] master.ServerManager(394): Registering regionserver=jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:25,111 DEBUG [RS:1;jenkins-hbase9:35929] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4 2023-07-14 11:12:25,111 DEBUG [RS:1;jenkins-hbase9:35929] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36847 2023-07-14 11:12:25,111 DEBUG [RS:1;jenkins-hbase9:35929] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 11:12:25,114 DEBUG [RS:2;jenkins-hbase9:40207] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4 2023-07-14 11:12:25,114 DEBUG [RS:2;jenkins-hbase9:40207] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36847 2023-07-14 11:12:25,114 DEBUG [RS:2;jenkins-hbase9:40207] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 11:12:25,118 DEBUG [RS:0;jenkins-hbase9:46581] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4 2023-07-14 11:12:25,118 DEBUG [RS:0;jenkins-hbase9:46581] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36847 2023-07-14 11:12:25,118 DEBUG [RS:0;jenkins-hbase9:46581] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-14 11:12:25,127 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 11:12:25,132 DEBUG [RS:2;jenkins-hbase9:40207] zookeeper.ZKUtil(162): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:25,132 WARN [RS:2;jenkins-hbase9:40207] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 11:12:25,133 INFO [RS:2;jenkins-hbase9:40207] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 11:12:25,134 DEBUG [RS:1;jenkins-hbase9:35929] zookeeper.ZKUtil(162): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:25,134 WARN [RS:1;jenkins-hbase9:35929] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 11:12:25,134 INFO [RS:1;jenkins-hbase9:35929] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 11:12:25,134 DEBUG [RS:0;jenkins-hbase9:46581] zookeeper.ZKUtil(162): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:25,134 WARN [RS:0;jenkins-hbase9:46581] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-14 11:12:25,134 INFO [RS:0;jenkins-hbase9:46581] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 11:12:25,135 DEBUG [RS:0;jenkins-hbase9:46581] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/WALs/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:25,134 DEBUG [RS:2;jenkins-hbase9:40207] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/WALs/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:25,134 DEBUG [RS:1;jenkins-hbase9:35929] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/WALs/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:25,135 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,40207,1689333142617] 2023-07-14 11:12:25,139 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,35929,1689333142490] 2023-07-14 11:12:25,139 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase9.apache.org,46581,1689333142353] 2023-07-14 11:12:25,178 DEBUG [PEWorker-2] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:25,182 DEBUG [RS:0;jenkins-hbase9:46581] zookeeper.ZKUtil(162): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:25,183 DEBUG [RS:0;jenkins-hbase9:46581] zookeeper.ZKUtil(162): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:25,184 DEBUG [RS:0;jenkins-hbase9:46581] zookeeper.ZKUtil(162): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:25,191 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-14 11:12:25,201 DEBUG [RS:1;jenkins-hbase9:35929] zookeeper.ZKUtil(162): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:25,201 DEBUG [RS:1;jenkins-hbase9:35929] zookeeper.ZKUtil(162): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:25,204 DEBUG [RS:1;jenkins-hbase9:35929] zookeeper.ZKUtil(162): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:25,208 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740/info 2023-07-14 11:12:25,209 DEBUG [RS:1;jenkins-hbase9:35929] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 11:12:25,209 DEBUG [RS:0;jenkins-hbase9:46581] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 11:12:25,210 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-14 11:12:25,212 DEBUG [RS:2;jenkins-hbase9:40207] zookeeper.ZKUtil(162): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:25,213 DEBUG [RS:2;jenkins-hbase9:40207] zookeeper.ZKUtil(162): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:25,213 DEBUG [RS:2;jenkins-hbase9:40207] zookeeper.ZKUtil(162): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:25,213 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:12:25,215 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-14 11:12:25,216 DEBUG [RS:2;jenkins-hbase9:40207] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-14 11:12:25,225 INFO [RS:2;jenkins-hbase9:40207] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 11:12:25,225 INFO [RS:1;jenkins-hbase9:35929] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 11:12:25,226 INFO [RS:0;jenkins-hbase9:46581] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-14 11:12:25,227 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740/rep_barrier 2023-07-14 11:12:25,228 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-14 11:12:25,229 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:12:25,229 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-14 11:12:25,247 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740/table 2023-07-14 11:12:25,248 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-14 11:12:25,249 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:12:25,252 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740 2023-07-14 11:12:25,254 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740 2023-07-14 11:12:25,270 DEBUG [PEWorker-2] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-14 11:12:25,273 DEBUG [PEWorker-2] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-14 11:12:25,277 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:12:25,278 INFO [PEWorker-2] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62527347, jitterRate=-0.06826992332935333}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-14 11:12:25,278 DEBUG [PEWorker-2] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-14 11:12:25,278 DEBUG [PEWorker-2] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-14 11:12:25,278 INFO [PEWorker-2] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-14 11:12:25,278 DEBUG [PEWorker-2] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-14 11:12:25,278 DEBUG [PEWorker-2] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-14 11:12:25,279 DEBUG [PEWorker-2] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-14 11:12:25,284 INFO [RS:1;jenkins-hbase9:35929] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 11:12:25,286 INFO [RS:2;jenkins-hbase9:40207] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 11:12:25,294 INFO [PEWorker-2] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-14 11:12:25,295 DEBUG [PEWorker-2] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-14 11:12:25,298 INFO [RS:1;jenkins-hbase9:35929] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 11:12:25,298 INFO [RS:1;jenkins-hbase9:35929] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,287 INFO [RS:0;jenkins-hbase9:46581] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-14 11:12:25,302 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-14 11:12:25,302 INFO [PEWorker-2] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-14 11:12:25,302 INFO [RS:2;jenkins-hbase9:40207] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 11:12:25,303 INFO [RS:2;jenkins-hbase9:40207] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,304 INFO [RS:1;jenkins-hbase9:35929] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 11:12:25,306 INFO [RS:0;jenkins-hbase9:46581] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-14 11:12:25,306 INFO [RS:0;jenkins-hbase9:46581] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,325 INFO [RS:0;jenkins-hbase9:46581] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 11:12:25,326 INFO [RS:2;jenkins-hbase9:40207] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-14 11:12:25,331 INFO [RS:0;jenkins-hbase9:46581] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,332 DEBUG [RS:0;jenkins-hbase9:46581] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,332 DEBUG [RS:0;jenkins-hbase9:46581] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,332 INFO [RS:1;jenkins-hbase9:35929] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,332 INFO [RS:2;jenkins-hbase9:40207] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,332 DEBUG [RS:0;jenkins-hbase9:46581] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,333 DEBUG [RS:1;jenkins-hbase9:35929] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,334 DEBUG [RS:0;jenkins-hbase9:46581] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,334 DEBUG [RS:1;jenkins-hbase9:35929] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,334 DEBUG [RS:0;jenkins-hbase9:46581] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,334 DEBUG [RS:0;jenkins-hbase9:46581] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 11:12:25,334 DEBUG [RS:0;jenkins-hbase9:46581] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,334 DEBUG [RS:1;jenkins-hbase9:35929] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,335 DEBUG [RS:2;jenkins-hbase9:40207] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,335 DEBUG [RS:2;jenkins-hbase9:40207] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,335 DEBUG [RS:2;jenkins-hbase9:40207] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,335 DEBUG [RS:2;jenkins-hbase9:40207] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,335 DEBUG [RS:2;jenkins-hbase9:40207] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,335 DEBUG [RS:2;jenkins-hbase9:40207] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 11:12:25,335 DEBUG [RS:2;jenkins-hbase9:40207] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,335 DEBUG [RS:2;jenkins-hbase9:40207] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,335 DEBUG [RS:2;jenkins-hbase9:40207] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,335 DEBUG [RS:2;jenkins-hbase9:40207] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,336 DEBUG [RS:1;jenkins-hbase9:35929] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,336 DEBUG [RS:1;jenkins-hbase9:35929] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,336 DEBUG [RS:1;jenkins-hbase9:35929] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase9:0, corePoolSize=2, maxPoolSize=2 2023-07-14 11:12:25,336 DEBUG [RS:1;jenkins-hbase9:35929] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,336 DEBUG [RS:1;jenkins-hbase9:35929] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,336 DEBUG [RS:1;jenkins-hbase9:35929] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,336 DEBUG [RS:1;jenkins-hbase9:35929] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,337 DEBUG [RS:0;jenkins-hbase9:46581] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,338 DEBUG [RS:0;jenkins-hbase9:46581] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,338 DEBUG [RS:0;jenkins-hbase9:46581] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase9:0, corePoolSize=1, maxPoolSize=1 2023-07-14 11:12:25,339 INFO [RS:2;jenkins-hbase9:40207] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,339 INFO [RS:2;jenkins-hbase9:40207] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,339 INFO [RS:2;jenkins-hbase9:40207] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,340 INFO [RS:1;jenkins-hbase9:35929] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,340 INFO [RS:1;jenkins-hbase9:35929] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,340 INFO [RS:1;jenkins-hbase9:35929] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,341 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-14 11:12:25,358 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-14 11:12:25,362 INFO [RS:0;jenkins-hbase9:46581] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,362 INFO [RS:0;jenkins-hbase9:46581] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,362 INFO [RS:0;jenkins-hbase9:46581] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,371 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-14 11:12:25,372 INFO [RS:2;jenkins-hbase9:40207] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 11:12:25,376 INFO [RS:2;jenkins-hbase9:40207] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,40207,1689333142617-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,378 INFO [RS:0;jenkins-hbase9:46581] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 11:12:25,379 INFO [RS:0;jenkins-hbase9:46581] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,46581,1689333142353-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,382 INFO [RS:1;jenkins-hbase9:35929] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-14 11:12:25,382 INFO [RS:1;jenkins-hbase9:35929] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,35929,1689333142490-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:25,430 INFO [RS:0;jenkins-hbase9:46581] regionserver.Replication(203): jenkins-hbase9.apache.org,46581,1689333142353 started 2023-07-14 11:12:25,431 INFO [RS:0;jenkins-hbase9:46581] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,46581,1689333142353, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:46581, sessionid=0x101637acd0d0001 2023-07-14 11:12:25,431 DEBUG [RS:0;jenkins-hbase9:46581] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 11:12:25,431 DEBUG [RS:0;jenkins-hbase9:46581] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:25,431 DEBUG [RS:0;jenkins-hbase9:46581] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,46581,1689333142353' 2023-07-14 11:12:25,431 DEBUG [RS:0;jenkins-hbase9:46581] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 11:12:25,441 DEBUG [RS:0;jenkins-hbase9:46581] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 11:12:25,442 DEBUG [RS:0;jenkins-hbase9:46581] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 11:12:25,442 DEBUG [RS:0;jenkins-hbase9:46581] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 11:12:25,442 DEBUG [RS:0;jenkins-hbase9:46581] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:25,442 DEBUG [RS:0;jenkins-hbase9:46581] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,46581,1689333142353' 2023-07-14 11:12:25,442 DEBUG [RS:0;jenkins-hbase9:46581] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:25,443 DEBUG [RS:0;jenkins-hbase9:46581] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:25,443 DEBUG [RS:0;jenkins-hbase9:46581] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 11:12:25,443 INFO [RS:0;jenkins-hbase9:46581] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 11:12:25,444 INFO [RS:0;jenkins-hbase9:46581] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 11:12:25,449 INFO [RS:1;jenkins-hbase9:35929] regionserver.Replication(203): jenkins-hbase9.apache.org,35929,1689333142490 started 2023-07-14 11:12:25,450 INFO [RS:1;jenkins-hbase9:35929] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,35929,1689333142490, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:35929, sessionid=0x101637acd0d0002 2023-07-14 11:12:25,450 DEBUG [RS:1;jenkins-hbase9:35929] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 11:12:25,450 DEBUG [RS:1;jenkins-hbase9:35929] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:25,452 DEBUG [RS:1;jenkins-hbase9:35929] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,35929,1689333142490' 2023-07-14 11:12:25,452 DEBUG [RS:1;jenkins-hbase9:35929] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 11:12:25,457 DEBUG [RS:1;jenkins-hbase9:35929] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 11:12:25,458 DEBUG [RS:1;jenkins-hbase9:35929] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 11:12:25,458 DEBUG [RS:1;jenkins-hbase9:35929] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 11:12:25,490 INFO [RS:2;jenkins-hbase9:40207] regionserver.Replication(203): jenkins-hbase9.apache.org,40207,1689333142617 started 2023-07-14 11:12:25,491 INFO [RS:2;jenkins-hbase9:40207] regionserver.HRegionServer(1637): Serving as jenkins-hbase9.apache.org,40207,1689333142617, RpcServer on jenkins-hbase9.apache.org/172.31.2.10:40207, sessionid=0x101637acd0d0003 2023-07-14 11:12:25,491 DEBUG [RS:2;jenkins-hbase9:40207] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-14 11:12:25,491 DEBUG [RS:2;jenkins-hbase9:40207] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:25,491 DEBUG [RS:2;jenkins-hbase9:40207] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,40207,1689333142617' 2023-07-14 11:12:25,491 DEBUG [RS:2;jenkins-hbase9:40207] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-14 11:12:25,492 DEBUG [RS:2;jenkins-hbase9:40207] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-14 11:12:25,493 DEBUG [RS:2;jenkins-hbase9:40207] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-14 11:12:25,493 DEBUG [RS:2;jenkins-hbase9:40207] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-14 11:12:25,458 DEBUG [RS:1;jenkins-hbase9:35929] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:25,500 DEBUG [RS:1;jenkins-hbase9:35929] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,35929,1689333142490' 2023-07-14 11:12:25,500 DEBUG [RS:1;jenkins-hbase9:35929] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:25,501 DEBUG [RS:1;jenkins-hbase9:35929] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:25,493 DEBUG [RS:2;jenkins-hbase9:40207] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:25,501 DEBUG [RS:2;jenkins-hbase9:40207] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase9.apache.org,40207,1689333142617' 2023-07-14 11:12:25,501 DEBUG [RS:2;jenkins-hbase9:40207] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:25,502 DEBUG [RS:1;jenkins-hbase9:35929] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 11:12:25,502 DEBUG [RS:2;jenkins-hbase9:40207] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:25,503 DEBUG [RS:2;jenkins-hbase9:40207] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-14 11:12:25,502 INFO [RS:1;jenkins-hbase9:35929] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 11:12:25,503 INFO [RS:2;jenkins-hbase9:40207] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-14 11:12:25,507 INFO [RS:1;jenkins-hbase9:35929] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 11:12:25,507 INFO [RS:2;jenkins-hbase9:40207] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-14 11:12:25,525 DEBUG [jenkins-hbase9:38311] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-14 11:12:25,530 DEBUG [jenkins-hbase9:38311] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 11:12:25,537 DEBUG [jenkins-hbase9:38311] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 11:12:25,537 DEBUG [jenkins-hbase9:38311] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 11:12:25,537 DEBUG [jenkins-hbase9:38311] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 11:12:25,537 DEBUG [jenkins-hbase9:38311] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 11:12:25,541 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,40207,1689333142617, state=OPENING 2023-07-14 11:12:25,561 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-14 11:12:25,563 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 11:12:25,564 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-14 11:12:25,568 INFO [RS:0;jenkins-hbase9:46581] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C46581%2C1689333142353, suffix=, logDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/WALs/jenkins-hbase9.apache.org,46581,1689333142353, archiveDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/oldWALs, maxLogs=32 2023-07-14 11:12:25,586 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,40207,1689333142617}] 2023-07-14 11:12:25,613 INFO [RS:1;jenkins-hbase9:35929] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C35929%2C1689333142490, suffix=, logDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/WALs/jenkins-hbase9.apache.org,35929,1689333142490, archiveDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/oldWALs, maxLogs=32 2023-07-14 11:12:25,613 INFO [RS:2;jenkins-hbase9:40207] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C40207%2C1689333142617, suffix=, logDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/WALs/jenkins-hbase9.apache.org,40207,1689333142617, archiveDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/oldWALs, maxLogs=32 2023-07-14 11:12:25,696 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46299,DS-cf8f7062-492e-484c-a42b-e87ac240e2d7,DISK] 2023-07-14 11:12:25,697 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33489,DS-9e91bd05-d5ac-45de-bebd-4f24d0a952ff,DISK] 2023-07-14 11:12:25,697 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36163,DS-d4ee9d5c-c919-44fd-88b3-93882a3de5f2,DISK] 2023-07-14 11:12:25,744 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36163,DS-d4ee9d5c-c919-44fd-88b3-93882a3de5f2,DISK] 2023-07-14 11:12:25,744 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46299,DS-cf8f7062-492e-484c-a42b-e87ac240e2d7,DISK] 2023-07-14 11:12:25,747 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33489,DS-9e91bd05-d5ac-45de-bebd-4f24d0a952ff,DISK] 2023-07-14 11:12:25,754 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36163,DS-d4ee9d5c-c919-44fd-88b3-93882a3de5f2,DISK] 2023-07-14 11:12:25,755 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33489,DS-9e91bd05-d5ac-45de-bebd-4f24d0a952ff,DISK] 2023-07-14 11:12:25,756 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46299,DS-cf8f7062-492e-484c-a42b-e87ac240e2d7,DISK] 2023-07-14 11:12:25,767 INFO [RS:0;jenkins-hbase9:46581] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/WALs/jenkins-hbase9.apache.org,46581,1689333142353/jenkins-hbase9.apache.org%2C46581%2C1689333142353.1689333145575 2023-07-14 11:12:25,780 INFO [RS:1;jenkins-hbase9:35929] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/WALs/jenkins-hbase9.apache.org,35929,1689333142490/jenkins-hbase9.apache.org%2C35929%2C1689333142490.1689333145633 2023-07-14 11:12:25,781 DEBUG [RS:0;jenkins-hbase9:46581] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36163,DS-d4ee9d5c-c919-44fd-88b3-93882a3de5f2,DISK], DatanodeInfoWithStorage[127.0.0.1:33489,DS-9e91bd05-d5ac-45de-bebd-4f24d0a952ff,DISK], DatanodeInfoWithStorage[127.0.0.1:46299,DS-cf8f7062-492e-484c-a42b-e87ac240e2d7,DISK]] 2023-07-14 11:12:25,786 DEBUG [RS:1;jenkins-hbase9:35929] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46299,DS-cf8f7062-492e-484c-a42b-e87ac240e2d7,DISK], DatanodeInfoWithStorage[127.0.0.1:36163,DS-d4ee9d5c-c919-44fd-88b3-93882a3de5f2,DISK], DatanodeInfoWithStorage[127.0.0.1:33489,DS-9e91bd05-d5ac-45de-bebd-4f24d0a952ff,DISK]] 2023-07-14 11:12:25,792 INFO [RS:2;jenkins-hbase9:40207] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/WALs/jenkins-hbase9.apache.org,40207,1689333142617/jenkins-hbase9.apache.org%2C40207%2C1689333142617.1689333145639 2023-07-14 11:12:25,793 DEBUG [RS:2;jenkins-hbase9:40207] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36163,DS-d4ee9d5c-c919-44fd-88b3-93882a3de5f2,DISK], DatanodeInfoWithStorage[127.0.0.1:46299,DS-cf8f7062-492e-484c-a42b-e87ac240e2d7,DISK], DatanodeInfoWithStorage[127.0.0.1:33489,DS-9e91bd05-d5ac-45de-bebd-4f24d0a952ff,DISK]] 2023-07-14 11:12:25,963 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:25,966 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 11:12:25,977 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52082, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 11:12:26,002 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-14 11:12:26,003 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-14 11:12:26,007 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase9.apache.org%2C40207%2C1689333142617.meta, suffix=.meta, logDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/WALs/jenkins-hbase9.apache.org,40207,1689333142617, archiveDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/oldWALs, maxLogs=32 2023-07-14 11:12:26,040 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33489,DS-9e91bd05-d5ac-45de-bebd-4f24d0a952ff,DISK] 2023-07-14 11:12:26,048 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36163,DS-d4ee9d5c-c919-44fd-88b3-93882a3de5f2,DISK] 2023-07-14 11:12:26,058 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46299,DS-cf8f7062-492e-484c-a42b-e87ac240e2d7,DISK] 2023-07-14 11:12:26,073 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/WALs/jenkins-hbase9.apache.org,40207,1689333142617/jenkins-hbase9.apache.org%2C40207%2C1689333142617.meta.1689333146009.meta 2023-07-14 11:12:26,074 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33489,DS-9e91bd05-d5ac-45de-bebd-4f24d0a952ff,DISK], DatanodeInfoWithStorage[127.0.0.1:36163,DS-d4ee9d5c-c919-44fd-88b3-93882a3de5f2,DISK], DatanodeInfoWithStorage[127.0.0.1:46299,DS-cf8f7062-492e-484c-a42b-e87ac240e2d7,DISK]] 2023-07-14 11:12:26,074 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-14 11:12:26,076 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-14 11:12:26,077 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:12:26,078 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-14 11:12:26,081 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-14 11:12:26,083 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-14 11:12:26,100 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-14 11:12:26,100 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:26,100 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-14 11:12:26,100 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-14 11:12:26,105 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-14 11:12:26,109 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740/info 2023-07-14 11:12:26,109 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740/info 2023-07-14 11:12:26,110 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-14 11:12:26,112 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:12:26,112 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-14 11:12:26,114 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740/rep_barrier 2023-07-14 11:12:26,114 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740/rep_barrier 2023-07-14 11:12:26,115 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-14 11:12:26,118 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:12:26,118 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-14 11:12:26,121 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740/table 2023-07-14 11:12:26,121 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740/table 2023-07-14 11:12:26,121 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-14 11:12:26,123 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:12:26,125 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740 2023-07-14 11:12:26,132 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740 2023-07-14 11:12:26,138 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-14 11:12:26,142 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-14 11:12:26,144 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66132796, jitterRate=-0.014544546604156494}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-14 11:12:26,148 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-14 11:12:26,164 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689333145952 2023-07-14 11:12:26,195 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-14 11:12:26,196 INFO [RS_OPEN_META-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-14 11:12:26,201 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase9.apache.org,40207,1689333142617, state=OPEN 2023-07-14 11:12:26,204 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-14 11:12:26,204 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-14 11:12:26,213 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-14 11:12:26,213 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase9.apache.org,40207,1689333142617 in 618 msec 2023-07-14 11:12:26,221 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-14 11:12:26,222 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 874 msec 2023-07-14 11:12:26,228 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.4800 sec 2023-07-14 11:12:26,228 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689333146228, completionTime=-1 2023-07-14 11:12:26,228 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-14 11:12:26,229 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-14 11:12:26,329 DEBUG [hconnection-0x49bc206a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:26,333 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52088, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:26,363 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-14 11:12:26,363 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689333206363 2023-07-14 11:12:26,363 INFO [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689333266363 2023-07-14 11:12:26,363 INFO [master/jenkins-hbase9:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 134 msec 2023-07-14 11:12:26,421 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,38311,1689333140751-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:26,421 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,38311,1689333140751-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:26,421 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,38311,1689333140751-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:26,423 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase9:38311, period=300000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:26,424 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-14 11:12:26,435 DEBUG [master/jenkins-hbase9:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-14 11:12:26,448 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-14 11:12:26,450 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 11:12:26,463 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-14 11:12:26,467 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 11:12:26,472 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 11:12:26,526 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/hbase/namespace/e0c5a0ab4e8c0f43291fc116d0cd5122 2023-07-14 11:12:26,530 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/hbase/namespace/e0c5a0ab4e8c0f43291fc116d0cd5122 empty. 2023-07-14 11:12:26,531 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/hbase/namespace/e0c5a0ab4e8c0f43291fc116d0cd5122 2023-07-14 11:12:26,531 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-14 11:12:26,647 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-14 11:12:26,653 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => e0c5a0ab4e8c0f43291fc116d0cd5122, NAME => 'hbase:namespace,,1689333146449.e0c5a0ab4e8c0f43291fc116d0cd5122.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp 2023-07-14 11:12:26,714 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689333146449.e0c5a0ab4e8c0f43291fc116d0cd5122.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:26,715 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing e0c5a0ab4e8c0f43291fc116d0cd5122, disabling compactions & flushes 2023-07-14 11:12:26,715 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689333146449.e0c5a0ab4e8c0f43291fc116d0cd5122. 2023-07-14 11:12:26,716 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689333146449.e0c5a0ab4e8c0f43291fc116d0cd5122. 2023-07-14 11:12:26,716 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689333146449.e0c5a0ab4e8c0f43291fc116d0cd5122. after waiting 0 ms 2023-07-14 11:12:26,716 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689333146449.e0c5a0ab4e8c0f43291fc116d0cd5122. 2023-07-14 11:12:26,716 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689333146449.e0c5a0ab4e8c0f43291fc116d0cd5122. 2023-07-14 11:12:26,716 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for e0c5a0ab4e8c0f43291fc116d0cd5122: 2023-07-14 11:12:26,722 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 11:12:26,746 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689333146449.e0c5a0ab4e8c0f43291fc116d0cd5122.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689333146728"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333146728"}]},"ts":"1689333146728"} 2023-07-14 11:12:26,783 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-14 11:12:26,785 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 11:12:26,790 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333146786"}]},"ts":"1689333146786"} 2023-07-14 11:12:26,794 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-14 11:12:26,799 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 11:12:26,801 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 11:12:26,801 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 11:12:26,801 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 11:12:26,801 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 11:12:26,803 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e0c5a0ab4e8c0f43291fc116d0cd5122, ASSIGN}] 2023-07-14 11:12:26,806 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e0c5a0ab4e8c0f43291fc116d0cd5122, ASSIGN 2023-07-14 11:12:26,808 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e0c5a0ab4e8c0f43291fc116d0cd5122, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40207,1689333142617; forceNewPlan=false, retain=false 2023-07-14 11:12:26,961 INFO [jenkins-hbase9:38311] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 11:12:26,962 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e0c5a0ab4e8c0f43291fc116d0cd5122, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:26,963 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689333146449.e0c5a0ab4e8c0f43291fc116d0cd5122.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689333146962"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333146962"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333146962"}]},"ts":"1689333146962"} 2023-07-14 11:12:26,967 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e0c5a0ab4e8c0f43291fc116d0cd5122, server=jenkins-hbase9.apache.org,40207,1689333142617}] 2023-07-14 11:12:27,127 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689333146449.e0c5a0ab4e8c0f43291fc116d0cd5122. 2023-07-14 11:12:27,128 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e0c5a0ab4e8c0f43291fc116d0cd5122, NAME => 'hbase:namespace,,1689333146449.e0c5a0ab4e8c0f43291fc116d0cd5122.', STARTKEY => '', ENDKEY => ''} 2023-07-14 11:12:27,128 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689333146449.e0c5a0ab4e8c0f43291fc116d0cd5122. service=AccessControlService 2023-07-14 11:12:27,129 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:12:27,129 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e0c5a0ab4e8c0f43291fc116d0cd5122 2023-07-14 11:12:27,129 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689333146449.e0c5a0ab4e8c0f43291fc116d0cd5122.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:27,130 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for e0c5a0ab4e8c0f43291fc116d0cd5122 2023-07-14 11:12:27,130 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for e0c5a0ab4e8c0f43291fc116d0cd5122 2023-07-14 11:12:27,132 INFO [StoreOpener-e0c5a0ab4e8c0f43291fc116d0cd5122-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e0c5a0ab4e8c0f43291fc116d0cd5122 2023-07-14 11:12:27,134 DEBUG [StoreOpener-e0c5a0ab4e8c0f43291fc116d0cd5122-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/namespace/e0c5a0ab4e8c0f43291fc116d0cd5122/info 2023-07-14 11:12:27,134 DEBUG [StoreOpener-e0c5a0ab4e8c0f43291fc116d0cd5122-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/namespace/e0c5a0ab4e8c0f43291fc116d0cd5122/info 2023-07-14 11:12:27,135 INFO [StoreOpener-e0c5a0ab4e8c0f43291fc116d0cd5122-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e0c5a0ab4e8c0f43291fc116d0cd5122 columnFamilyName info 2023-07-14 11:12:27,136 INFO [StoreOpener-e0c5a0ab4e8c0f43291fc116d0cd5122-1] regionserver.HStore(310): Store=e0c5a0ab4e8c0f43291fc116d0cd5122/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:12:27,138 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/namespace/e0c5a0ab4e8c0f43291fc116d0cd5122 2023-07-14 11:12:27,139 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/namespace/e0c5a0ab4e8c0f43291fc116d0cd5122 2023-07-14 11:12:27,143 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for e0c5a0ab4e8c0f43291fc116d0cd5122 2023-07-14 11:12:27,147 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/namespace/e0c5a0ab4e8c0f43291fc116d0cd5122/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:12:27,148 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened e0c5a0ab4e8c0f43291fc116d0cd5122; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74830888, jitterRate=0.11506712436676025}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:12:27,148 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for e0c5a0ab4e8c0f43291fc116d0cd5122: 2023-07-14 11:12:27,150 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689333146449.e0c5a0ab4e8c0f43291fc116d0cd5122., pid=6, masterSystemTime=1689333147120 2023-07-14 11:12:27,155 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689333146449.e0c5a0ab4e8c0f43291fc116d0cd5122. 2023-07-14 11:12:27,155 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689333146449.e0c5a0ab4e8c0f43291fc116d0cd5122. 2023-07-14 11:12:27,156 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e0c5a0ab4e8c0f43291fc116d0cd5122, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:27,156 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689333146449.e0c5a0ab4e8c0f43291fc116d0cd5122.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689333147155"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333147155"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333147155"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333147155"}]},"ts":"1689333147155"} 2023-07-14 11:12:27,165 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-14 11:12:27,166 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e0c5a0ab4e8c0f43291fc116d0cd5122, server=jenkins-hbase9.apache.org,40207,1689333142617 in 193 msec 2023-07-14 11:12:27,172 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-14 11:12:27,172 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e0c5a0ab4e8c0f43291fc116d0cd5122, ASSIGN in 362 msec 2023-07-14 11:12:27,178 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 11:12:27,178 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333147178"}]},"ts":"1689333147178"} 2023-07-14 11:12:27,182 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-14 11:12:27,186 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 11:12:27,189 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 735 msec 2023-07-14 11:12:27,267 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-14 11:12:27,268 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-14 11:12:27,268 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 11:12:27,310 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-14 11:12:27,335 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-14 11:12:27,345 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 44 msec 2023-07-14 11:12:27,354 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-14 11:12:27,368 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-14 11:12:27,376 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 20 msec 2023-07-14 11:12:27,398 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-14 11:12:27,401 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-14 11:12:27,402 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 4.646sec 2023-07-14 11:12:27,405 INFO [master/jenkins-hbase9:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-14 11:12:27,407 INFO [master/jenkins-hbase9:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-14 11:12:27,408 INFO [master/jenkins-hbase9:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-14 11:12:27,409 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,38311,1689333140751-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-14 11:12:27,410 INFO [master/jenkins-hbase9:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase9.apache.org,38311,1689333140751-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-14 11:12:27,442 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-14 11:12:27,447 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-14 11:12:27,450 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 11:12:27,452 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 11:12:27,455 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/hbase/acl/5065a3a7344a0e87bfc581aedd76c2e3 2023-07-14 11:12:27,456 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/hbase/acl/5065a3a7344a0e87bfc581aedd76c2e3 empty. 2023-07-14 11:12:27,457 INFO [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-14 11:12:27,459 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/hbase/acl/5065a3a7344a0e87bfc581aedd76c2e3 2023-07-14 11:12:27,459 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-14 11:12:27,472 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 11:12:27,505 DEBUG [Listener at localhost/39195] zookeeper.ReadOnlyZKClient(139): Connect 0x5f9eca1b to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:12:27,544 DEBUG [Listener at localhost/39195] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68214c6c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:12:27,570 DEBUG [hconnection-0xc46609f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:27,576 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-14 11:12:27,577 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 11:12:27,586 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5065a3a7344a0e87bfc581aedd76c2e3, NAME => 'hbase:acl,,1689333147434.5065a3a7344a0e87bfc581aedd76c2e3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp 2023-07-14 11:12:27,601 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:52090, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:27,607 INFO [Listener at localhost/39195] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase9.apache.org,38311,1689333140751 2023-07-14 11:12:27,614 INFO [Listener at localhost/39195] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-14 11:12:27,614 INFO [Listener at localhost/39195] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/test.cache.data in system properties and HBase conf 2023-07-14 11:12:27,614 INFO [Listener at localhost/39195] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/hadoop.tmp.dir in system properties and HBase conf 2023-07-14 11:12:27,615 INFO [Listener at localhost/39195] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/hadoop.log.dir in system properties and HBase conf 2023-07-14 11:12:27,615 INFO [Listener at localhost/39195] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-14 11:12:27,615 INFO [Listener at localhost/39195] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-14 11:12:27,615 INFO [Listener at localhost/39195] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-14 11:12:27,615 INFO [Listener at localhost/39195] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-14 11:12:27,615 INFO [Listener at localhost/39195] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-14 11:12:27,616 INFO [Listener at localhost/39195] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-14 11:12:27,616 INFO [Listener at localhost/39195] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 11:12:27,616 INFO [Listener at localhost/39195] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-14 11:12:27,616 INFO [Listener at localhost/39195] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-14 11:12:27,616 INFO [Listener at localhost/39195] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-14 11:12:27,616 INFO [Listener at localhost/39195] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 11:12:27,616 INFO [Listener at localhost/39195] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-14 11:12:27,616 INFO [Listener at localhost/39195] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/nfs.dump.dir in system properties and HBase conf 2023-07-14 11:12:27,616 INFO [Listener at localhost/39195] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/java.io.tmpdir in system properties and HBase conf 2023-07-14 11:12:27,616 INFO [Listener at localhost/39195] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-14 11:12:27,616 INFO [Listener at localhost/39195] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-14 11:12:27,617 INFO [Listener at localhost/39195] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-14 11:12:27,654 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689333147434.5065a3a7344a0e87bfc581aedd76c2e3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:27,654 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 5065a3a7344a0e87bfc581aedd76c2e3, disabling compactions & flushes 2023-07-14 11:12:27,654 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689333147434.5065a3a7344a0e87bfc581aedd76c2e3. 2023-07-14 11:12:27,654 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689333147434.5065a3a7344a0e87bfc581aedd76c2e3. 2023-07-14 11:12:27,654 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689333147434.5065a3a7344a0e87bfc581aedd76c2e3. after waiting 0 ms 2023-07-14 11:12:27,654 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689333147434.5065a3a7344a0e87bfc581aedd76c2e3. 2023-07-14 11:12:27,654 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689333147434.5065a3a7344a0e87bfc581aedd76c2e3. 2023-07-14 11:12:27,654 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 5065a3a7344a0e87bfc581aedd76c2e3: 2023-07-14 11:12:27,660 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 11:12:27,662 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689333147434.5065a3a7344a0e87bfc581aedd76c2e3.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689333147662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333147662"}]},"ts":"1689333147662"} 2023-07-14 11:12:27,668 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-14 11:12:27,670 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 11:12:27,670 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333147670"}]},"ts":"1689333147670"} 2023-07-14 11:12:27,673 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-14 11:12:27,679 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 11:12:27,680 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 11:12:27,680 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 11:12:27,680 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 11:12:27,680 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 11:12:27,681 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=5065a3a7344a0e87bfc581aedd76c2e3, ASSIGN}] 2023-07-14 11:12:27,697 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=5065a3a7344a0e87bfc581aedd76c2e3, ASSIGN 2023-07-14 11:12:27,705 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=5065a3a7344a0e87bfc581aedd76c2e3, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46581,1689333142353; forceNewPlan=false, retain=false 2023-07-14 11:12:27,777 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 11:12:27,856 INFO [jenkins-hbase9:38311] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 11:12:27,860 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=5065a3a7344a0e87bfc581aedd76c2e3, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:27,860 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689333147434.5065a3a7344a0e87bfc581aedd76c2e3.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689333147859"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333147859"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333147859"}]},"ts":"1689333147859"} 2023-07-14 11:12:27,864 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 5065a3a7344a0e87bfc581aedd76c2e3, server=jenkins-hbase9.apache.org,46581,1689333142353}] 2023-07-14 11:12:28,049 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:28,050 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 11:12:28,071 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:46696, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 11:12:28,078 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 11:12:28,088 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689333147434.5065a3a7344a0e87bfc581aedd76c2e3. 2023-07-14 11:12:28,088 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5065a3a7344a0e87bfc581aedd76c2e3, NAME => 'hbase:acl,,1689333147434.5065a3a7344a0e87bfc581aedd76c2e3.', STARTKEY => '', ENDKEY => ''} 2023-07-14 11:12:28,089 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689333147434.5065a3a7344a0e87bfc581aedd76c2e3. service=AccessControlService 2023-07-14 11:12:28,089 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:12:28,090 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 5065a3a7344a0e87bfc581aedd76c2e3 2023-07-14 11:12:28,090 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689333147434.5065a3a7344a0e87bfc581aedd76c2e3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:28,090 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 5065a3a7344a0e87bfc581aedd76c2e3 2023-07-14 11:12:28,090 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 5065a3a7344a0e87bfc581aedd76c2e3 2023-07-14 11:12:28,099 INFO [StoreOpener-5065a3a7344a0e87bfc581aedd76c2e3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 5065a3a7344a0e87bfc581aedd76c2e3 2023-07-14 11:12:28,105 DEBUG [StoreOpener-5065a3a7344a0e87bfc581aedd76c2e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/acl/5065a3a7344a0e87bfc581aedd76c2e3/l 2023-07-14 11:12:28,105 DEBUG [StoreOpener-5065a3a7344a0e87bfc581aedd76c2e3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/acl/5065a3a7344a0e87bfc581aedd76c2e3/l 2023-07-14 11:12:28,106 INFO [StoreOpener-5065a3a7344a0e87bfc581aedd76c2e3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5065a3a7344a0e87bfc581aedd76c2e3 columnFamilyName l 2023-07-14 11:12:28,114 INFO [StoreOpener-5065a3a7344a0e87bfc581aedd76c2e3-1] regionserver.HStore(310): Store=5065a3a7344a0e87bfc581aedd76c2e3/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:12:28,124 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/acl/5065a3a7344a0e87bfc581aedd76c2e3 2023-07-14 11:12:28,126 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/acl/5065a3a7344a0e87bfc581aedd76c2e3 2023-07-14 11:12:28,131 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 5065a3a7344a0e87bfc581aedd76c2e3 2023-07-14 11:12:28,144 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/acl/5065a3a7344a0e87bfc581aedd76c2e3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:12:28,145 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 5065a3a7344a0e87bfc581aedd76c2e3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61832440, jitterRate=-0.07862484455108643}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:12:28,146 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 5065a3a7344a0e87bfc581aedd76c2e3: 2023-07-14 11:12:28,147 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689333147434.5065a3a7344a0e87bfc581aedd76c2e3., pid=11, masterSystemTime=1689333148049 2023-07-14 11:12:28,155 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689333147434.5065a3a7344a0e87bfc581aedd76c2e3. 2023-07-14 11:12:28,158 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689333147434.5065a3a7344a0e87bfc581aedd76c2e3. 2023-07-14 11:12:28,158 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=5065a3a7344a0e87bfc581aedd76c2e3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:28,158 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689333147434.5065a3a7344a0e87bfc581aedd76c2e3.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689333148158"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333148158"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333148158"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333148158"}]},"ts":"1689333148158"} 2023-07-14 11:12:28,173 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-14 11:12:28,173 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 5065a3a7344a0e87bfc581aedd76c2e3, server=jenkins-hbase9.apache.org,46581,1689333142353 in 298 msec 2023-07-14 11:12:28,179 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-14 11:12:28,179 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=5065a3a7344a0e87bfc581aedd76c2e3, ASSIGN in 492 msec 2023-07-14 11:12:28,181 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 11:12:28,181 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333148181"}]},"ts":"1689333148181"} 2023-07-14 11:12:28,195 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-14 11:12:28,200 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 11:12:28,204 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 758 msec 2023-07-14 11:12:28,578 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-14 11:12:28,579 INFO [master/jenkins-hbase9:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-14 11:12:28,610 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-14 11:12:29,301 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 11:12:29,647 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 11:12:29,666 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_36679_jobhistory____urgro9/webapp 2023-07-14 11:12:29,855 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-14 11:12:29,855 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-14 11:12:29,855 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 11:12:29,859 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 11:12:29,951 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 11:12:30,251 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 11:12:30,678 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-14 11:12:30,761 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:36679 2023-07-14 11:12:30,929 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:12:30,930 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-14 11:12:30,931 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:12:30,931 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-14 11:12:30,931 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-14 11:12:30,931 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-14 11:12:30,931 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:12:30,931 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-14 11:12:30,932 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-14 11:12:30,932 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-14 11:12:31,758 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 11:12:31,890 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-14 11:12:31,892 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-14 11:12:31,893 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-14 11:12:32,494 WARN [Listener at jenkins-hbase9.apache.org/46871] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 11:12:32,594 WARN [Listener at jenkins-hbase9.apache.org/46871] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 11:12:32,595 INFO [Listener at jenkins-hbase9.apache.org/46871] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 11:12:32,621 INFO [Listener at jenkins-hbase9.apache.org/46871] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_46819_cluster____.ku84s5/webapp 2023-07-14 11:12:32,715 INFO [Listener at jenkins-hbase9.apache.org/46871] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 11:12:32,715 INFO [Listener at jenkins-hbase9.apache.org/46871] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-14 11:12:32,715 INFO [Listener at jenkins-hbase9.apache.org/46871] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 11:12:32,716 INFO [Listener at jenkins-hbase9.apache.org/46871] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 11:12:32,726 INFO [Listener at jenkins-hbase9.apache.org/46871] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 11:12:33,006 INFO [Listener at jenkins-hbase9.apache.org/46871] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 11:12:33,147 INFO [Listener at jenkins-hbase9.apache.org/46871] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 11:12:33,174 INFO [Listener at jenkins-hbase9.apache.org/46871] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:46819 2023-07-14 11:12:33,715 WARN [Listener at jenkins-hbase9.apache.org/37809] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 11:12:33,748 WARN [Listener at jenkins-hbase9.apache.org/37809] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 11:12:33,749 INFO [Listener at jenkins-hbase9.apache.org/37809] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 11:12:33,757 INFO [Listener at jenkins-hbase9.apache.org/37809] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_35195_node____.1ff5j0/webapp 2023-07-14 11:12:33,813 INFO [Listener at jenkins-hbase9.apache.org/37809] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-14 11:12:33,814 INFO [Listener at jenkins-hbase9.apache.org/37809] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 11:12:33,814 INFO [Listener at jenkins-hbase9.apache.org/37809] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 11:12:33,814 INFO [Listener at jenkins-hbase9.apache.org/37809] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 11:12:33,825 INFO [Listener at jenkins-hbase9.apache.org/37809] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 11:12:33,855 INFO [Listener at jenkins-hbase9.apache.org/37809] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 11:12:34,028 INFO [Listener at jenkins-hbase9.apache.org/37809] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 11:12:34,069 INFO [Listener at jenkins-hbase9.apache.org/37809] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:35195 2023-07-14 11:12:34,526 WARN [Listener at jenkins-hbase9.apache.org/36907] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-14 11:12:34,539 WARN [Listener at jenkins-hbase9.apache.org/36907] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-14 11:12:34,540 INFO [Listener at jenkins-hbase9.apache.org/36907] log.Slf4jLog(67): jetty-6.1.26 2023-07-14 11:12:34,565 INFO [Listener at jenkins-hbase9.apache.org/36907] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/java.io.tmpdir/Jetty_jenkins.hbase9_apache_org_46637_node____k2kai9/webapp 2023-07-14 11:12:34,633 INFO [Listener at jenkins-hbase9.apache.org/36907] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-14 11:12:34,633 INFO [Listener at jenkins-hbase9.apache.org/36907] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-14 11:12:34,634 INFO [Listener at jenkins-hbase9.apache.org/36907] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-14 11:12:34,634 INFO [Listener at jenkins-hbase9.apache.org/36907] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-14 11:12:34,643 INFO [Listener at jenkins-hbase9.apache.org/36907] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 11:12:34,660 INFO [Listener at jenkins-hbase9.apache.org/36907] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 11:12:34,753 INFO [Listener at jenkins-hbase9.apache.org/36907] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-14 11:12:34,770 INFO [Listener at jenkins-hbase9.apache.org/36907] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:46637 2023-07-14 11:12:34,808 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-14 11:12:34,810 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:12:34,894 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=1241, ProcessCount=184, AvailableMemoryMB=4742 2023-07-14 11:12:34,895 WARN [Listener at jenkins-hbase9.apache.org/36907] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-07-14 11:12:34,911 DEBUG [Listener at jenkins-hbase9.apache.org/36907] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-14 11:12:34,918 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:46888, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-14 11:12:34,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 11:12:34,930 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-14 11:12:34,932 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 11:12:34,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-14 11:12:34,934 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 11:12:34,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 11:12:34,941 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportWithTargetName/5b2ae149e90989cc8950bf5115e227b6 2023-07-14 11:12:34,941 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportWithTargetName/41d5e5ea7c2b721ce28b4052c3f7b73a 2023-07-14 11:12:34,943 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportWithTargetName/5b2ae149e90989cc8950bf5115e227b6 empty. 2023-07-14 11:12:34,943 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportWithTargetName/41d5e5ea7c2b721ce28b4052c3f7b73a empty. 2023-07-14 11:12:34,944 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportWithTargetName/5b2ae149e90989cc8950bf5115e227b6 2023-07-14 11:12:34,945 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportWithTargetName/41d5e5ea7c2b721ce28b4052c3f7b73a 2023-07-14 11:12:34,945 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-14 11:12:34,983 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-14 11:12:34,990 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5b2ae149e90989cc8950bf5115e227b6, NAME => 'testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp 2023-07-14 11:12:34,993 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 41d5e5ea7c2b721ce28b4052c3f7b73a, NAME => 'testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp 2023-07-14 11:12:35,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 11:12:35,070 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:35,071 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 41d5e5ea7c2b721ce28b4052c3f7b73a, disabling compactions & flushes 2023-07-14 11:12:35,071 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a. 2023-07-14 11:12:35,071 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a. 2023-07-14 11:12:35,071 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a. after waiting 0 ms 2023-07-14 11:12:35,072 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a. 2023-07-14 11:12:35,072 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a. 2023-07-14 11:12:35,072 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 41d5e5ea7c2b721ce28b4052c3f7b73a: 2023-07-14 11:12:35,072 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:35,072 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 5b2ae149e90989cc8950bf5115e227b6, disabling compactions & flushes 2023-07-14 11:12:35,072 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6. 2023-07-14 11:12:35,072 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6. 2023-07-14 11:12:35,072 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6. after waiting 0 ms 2023-07-14 11:12:35,072 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6. 2023-07-14 11:12:35,072 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6. 2023-07-14 11:12:35,072 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 5b2ae149e90989cc8950bf5115e227b6: 2023-07-14 11:12:35,082 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 11:12:35,084 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689333155083"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333155083"}]},"ts":"1689333155083"} 2023-07-14 11:12:35,084 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689333155083"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333155083"}]},"ts":"1689333155083"} 2023-07-14 11:12:35,136 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 11:12:35,138 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 11:12:35,138 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333155138"}]},"ts":"1689333155138"} 2023-07-14 11:12:35,140 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-14 11:12:35,145 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 11:12:35,147 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 11:12:35,147 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 11:12:35,147 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 11:12:35,147 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 11:12:35,147 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b2ae149e90989cc8950bf5115e227b6, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=41d5e5ea7c2b721ce28b4052c3f7b73a, ASSIGN}] 2023-07-14 11:12:35,150 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=41d5e5ea7c2b721ce28b4052c3f7b73a, ASSIGN 2023-07-14 11:12:35,150 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b2ae149e90989cc8950bf5115e227b6, ASSIGN 2023-07-14 11:12:35,154 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=41d5e5ea7c2b721ce28b4052c3f7b73a, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35929,1689333142490; forceNewPlan=false, retain=false 2023-07-14 11:12:35,154 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b2ae149e90989cc8950bf5115e227b6, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40207,1689333142617; forceNewPlan=false, retain=false 2023-07-14 11:12:35,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 11:12:35,304 INFO [jenkins-hbase9:38311] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 11:12:35,307 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5b2ae149e90989cc8950bf5115e227b6, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:35,307 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=41d5e5ea7c2b721ce28b4052c3f7b73a, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:35,307 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689333155307"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333155307"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333155307"}]},"ts":"1689333155307"} 2023-07-14 11:12:35,307 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689333155307"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333155307"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333155307"}]},"ts":"1689333155307"} 2023-07-14 11:12:35,310 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure 5b2ae149e90989cc8950bf5115e227b6, server=jenkins-hbase9.apache.org,40207,1689333142617}] 2023-07-14 11:12:35,312 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 41d5e5ea7c2b721ce28b4052c3f7b73a, server=jenkins-hbase9.apache.org,35929,1689333142490}] 2023-07-14 11:12:35,466 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:35,467 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 11:12:35,472 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 11:12:35,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6. 2023-07-14 11:12:35,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5b2ae149e90989cc8950bf5115e227b6, NAME => 'testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 11:12:35,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6. service=AccessControlService 2023-07-14 11:12:35,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:12:35,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 5b2ae149e90989cc8950bf5115e227b6 2023-07-14 11:12:35,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:35,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 5b2ae149e90989cc8950bf5115e227b6 2023-07-14 11:12:35,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 5b2ae149e90989cc8950bf5115e227b6 2023-07-14 11:12:35,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a. 2023-07-14 11:12:35,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 41d5e5ea7c2b721ce28b4052c3f7b73a, NAME => 'testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 11:12:35,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a. service=AccessControlService 2023-07-14 11:12:35,478 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:12:35,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 41d5e5ea7c2b721ce28b4052c3f7b73a 2023-07-14 11:12:35,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:35,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 41d5e5ea7c2b721ce28b4052c3f7b73a 2023-07-14 11:12:35,479 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 41d5e5ea7c2b721ce28b4052c3f7b73a 2023-07-14 11:12:35,479 INFO [StoreOpener-5b2ae149e90989cc8950bf5115e227b6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5b2ae149e90989cc8950bf5115e227b6 2023-07-14 11:12:35,480 INFO [StoreOpener-41d5e5ea7c2b721ce28b4052c3f7b73a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 41d5e5ea7c2b721ce28b4052c3f7b73a 2023-07-14 11:12:35,481 DEBUG [StoreOpener-5b2ae149e90989cc8950bf5115e227b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportWithTargetName/5b2ae149e90989cc8950bf5115e227b6/cf 2023-07-14 11:12:35,481 DEBUG [StoreOpener-5b2ae149e90989cc8950bf5115e227b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportWithTargetName/5b2ae149e90989cc8950bf5115e227b6/cf 2023-07-14 11:12:35,481 INFO [StoreOpener-5b2ae149e90989cc8950bf5115e227b6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b2ae149e90989cc8950bf5115e227b6 columnFamilyName cf 2023-07-14 11:12:35,482 INFO [StoreOpener-5b2ae149e90989cc8950bf5115e227b6-1] regionserver.HStore(310): Store=5b2ae149e90989cc8950bf5115e227b6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:12:35,484 DEBUG [StoreOpener-41d5e5ea7c2b721ce28b4052c3f7b73a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportWithTargetName/41d5e5ea7c2b721ce28b4052c3f7b73a/cf 2023-07-14 11:12:35,485 DEBUG [StoreOpener-41d5e5ea7c2b721ce28b4052c3f7b73a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportWithTargetName/41d5e5ea7c2b721ce28b4052c3f7b73a/cf 2023-07-14 11:12:35,486 INFO [StoreOpener-41d5e5ea7c2b721ce28b4052c3f7b73a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 41d5e5ea7c2b721ce28b4052c3f7b73a columnFamilyName cf 2023-07-14 11:12:35,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportWithTargetName/5b2ae149e90989cc8950bf5115e227b6 2023-07-14 11:12:35,487 INFO [StoreOpener-41d5e5ea7c2b721ce28b4052c3f7b73a-1] regionserver.HStore(310): Store=41d5e5ea7c2b721ce28b4052c3f7b73a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:12:35,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportWithTargetName/5b2ae149e90989cc8950bf5115e227b6 2023-07-14 11:12:35,489 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportWithTargetName/41d5e5ea7c2b721ce28b4052c3f7b73a 2023-07-14 11:12:35,490 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportWithTargetName/41d5e5ea7c2b721ce28b4052c3f7b73a 2023-07-14 11:12:35,494 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 5b2ae149e90989cc8950bf5115e227b6 2023-07-14 11:12:35,501 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 41d5e5ea7c2b721ce28b4052c3f7b73a 2023-07-14 11:12:35,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportWithTargetName/5b2ae149e90989cc8950bf5115e227b6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:12:35,509 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 5b2ae149e90989cc8950bf5115e227b6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60393982, jitterRate=-0.10005953907966614}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:12:35,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 5b2ae149e90989cc8950bf5115e227b6: 2023-07-14 11:12:35,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportWithTargetName/41d5e5ea7c2b721ce28b4052c3f7b73a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:12:35,511 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 41d5e5ea7c2b721ce28b4052c3f7b73a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69538051, jitterRate=0.03619770705699921}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:12:35,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 41d5e5ea7c2b721ce28b4052c3f7b73a: 2023-07-14 11:12:35,514 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6., pid=15, masterSystemTime=1689333155462 2023-07-14 11:12:35,514 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a., pid=16, masterSystemTime=1689333155466 2023-07-14 11:12:35,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6. 2023-07-14 11:12:35,519 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6. 2023-07-14 11:12:35,521 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5b2ae149e90989cc8950bf5115e227b6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:35,521 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a. 2023-07-14 11:12:35,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a. 2023-07-14 11:12:35,523 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689333155521"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333155521"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333155521"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333155521"}]},"ts":"1689333155521"} 2023-07-14 11:12:35,524 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=41d5e5ea7c2b721ce28b4052c3f7b73a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:35,524 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689333155523"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333155523"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333155523"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333155523"}]},"ts":"1689333155523"} 2023-07-14 11:12:35,532 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-14 11:12:35,533 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure 5b2ae149e90989cc8950bf5115e227b6, server=jenkins-hbase9.apache.org,40207,1689333142617 in 217 msec 2023-07-14 11:12:35,539 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-14 11:12:35,557 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 41d5e5ea7c2b721ce28b4052c3f7b73a, server=jenkins-hbase9.apache.org,35929,1689333142490 in 219 msec 2023-07-14 11:12:35,558 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b2ae149e90989cc8950bf5115e227b6, ASSIGN in 387 msec 2023-07-14 11:12:35,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 11:12:35,563 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=12 2023-07-14 11:12:35,564 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=41d5e5ea7c2b721ce28b4052c3f7b73a, ASSIGN in 411 msec 2023-07-14 11:12:35,565 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 11:12:35,565 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333155565"}]},"ts":"1689333155565"} 2023-07-14 11:12:35,568 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-14 11:12:35,574 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 11:12:35,581 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-14 11:12:35,591 DEBUG [PEWorker-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:35,604 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:35,612 DEBUG [hconnection-0x22321965-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:35,620 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-07-14 11:12:35,632 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46581] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 11:12:35,663 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 11:12:35,664 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 11:12:35,664 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 11:12:35,664 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-14 11:12:35,664 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 11:12:35,672 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 11:12:35,673 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 11:12:35,673 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 11:12:35,673 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-14 11:12:35,677 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 747 msec 2023-07-14 11:12:36,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-14 11:12:36,064 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-14 11:12:36,064 DEBUG [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-14 11:12:36,065 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:12:36,070 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-14 11:12:36,071 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:12:36,071 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-14 11:12:36,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 11:12:36,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689333156086 (current time:1689333156086). 2023-07-14 11:12:36,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 11:12:36,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(139): Connect 0x485db17b to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:12:36,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22a396ae, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:12:36,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:36,098 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35328, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:36,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x485db17b to 127.0.0.1:58300 2023-07-14 11:12:36,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:12:36,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(139): Connect 0x779b6074 to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:12:36,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13aaa5f1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:12:36,208 DEBUG [hconnection-0xe9e0af4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:36,211 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35344, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:36,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:36,217 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45990, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:36,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x779b6074 to 127.0.0.1:58300 2023-07-14 11:12:36,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:12:36,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 11:12:36,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 11:12:36,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 11:12:36,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 11:12:36,267 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 11:12:36,269 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689333756269 2023-07-14 11:12:36,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 11:12:36,278 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-14 11:12:36,280 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 11:12:36,282 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 11:12:36,283 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 22 msec 2023-07-14 11:12:36,284 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 11:12:36,285 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689333756285 2023-07-14 11:12:36,286 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 11:12:36,286 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 11:12:36,323 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,323 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-14 11:12:36,323 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:36,324 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-14 11:12:36,324 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-14 11:12:36,325 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,325 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,332 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:36,332 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:36,332 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:36,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:36,332 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:36,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:36,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:36,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:36,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:36,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:36,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,334 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,334 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,334 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:36,334 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:36,334 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 11:12:36,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 11:12:36,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,335 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 11:12:36,335 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 11:12:36,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-14 11:12:36,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,336 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:36,336 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 11:12:36,336 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 11:12:36,340 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,340 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,341 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,341 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 11:12:36,341 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 11:12:36,341 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:36,341 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:36,341 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 11:12:36,343 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 11:12:36,344 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 11:12:36,342 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 11:12:36,344 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40207,1689333142617' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 11:12:36,343 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:36,344 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 11:12:36,344 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 11:12:36,344 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46581,1689333142353' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 11:12:36,344 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-14 11:12:36,345 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35929,1689333142490' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-14 11:12:36,352 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:36,352 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:36,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:36,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:36,353 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,353 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,353 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:36,353 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:36,353 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:12:36,353 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,353 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:12:36,353 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,354 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:12:36,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:36,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:36,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:36,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:36,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:36,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40207,1689333142617' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-14 11:12:36,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@257adbe7[Count = 1] remaining members to acquire global barrier 2023-07-14 11:12:36,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:36,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:36,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:36,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:36,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:36,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:36,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:36,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:36,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:36,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35929,1689333142490' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-14 11:12:36,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@257adbe7[Count = 0] remaining members to acquire global barrier 2023-07-14 11:12:36,361 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-14 11:12:36,361 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,363 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,363 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,363 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,363 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 11:12:36,363 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 11:12:36,363 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:36,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,364 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 11:12:36,364 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 11:12:36,364 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,46581,1689333142353' in zk 2023-07-14 11:12:36,364 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:36,364 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 11:12:36,364 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:12:36,364 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:12:36,365 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a. 2023-07-14 11:12:36,365 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:12:36,365 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:12:36,365 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6. 2023-07-14 11:12:36,365 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a. started... 2023-07-14 11:12:36,365 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6. started... 2023-07-14 11:12:36,366 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 11:12:36,366 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:36,366 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 11:12:36,371 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b2ae149e90989cc8950bf5115e227b6: 2023-07-14 11:12:36,371 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 41d5e5ea7c2b721ce28b4052c3f7b73a: 2023-07-14 11:12:36,372 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,372 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,379 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:12:36,379 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:12:36,382 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 11:12:36,382 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 11:12:36,387 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:12:36,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 11:12:36,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:12:36,395 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 11:12:36,453 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a. completed. 2023-07-14 11:12:36,454 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a. 2023-07-14 11:12:36,454 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:12:36,454 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:12:36,454 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:36,454 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 11:12:36,454 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,35929,1689333142490' in zk 2023-07-14 11:12:36,455 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6. completed. 2023-07-14 11:12:36,456 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6. 2023-07-14 11:12:36,456 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:12:36,456 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:12:36,456 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:36,456 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-14 11:12:36,456 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,40207,1689333142617' in zk 2023-07-14 11:12:36,459 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 11:12:36,459 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:36,459 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 11:12:36,461 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:36,462 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:36,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:36,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:36,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:36,462 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 11:12:36,462 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:36,462 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-14 11:12:36,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:36,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:36,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:36,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:36,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:36,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:36,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:36,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:36,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:36,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,35929,1689333142490': 2023-07-14 11:12:36,470 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35929,1689333142490' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-14 11:12:36,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:36,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:36,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:36,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:36,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:36,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:36,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:36,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:36,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:36,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:36,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:36,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:36,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,40207,1689333142617': 2023-07-14 11:12:36,477 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40207,1689333142617' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-14 11:12:36,477 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-14 11:12:36,477 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 11:12:36,477 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 11:12:36,477 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,477 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 11:12:36,481 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,481 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,481 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,481 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:36,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:36,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:36,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,481 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,481 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:36,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,482 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:36,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:36,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:36,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:36,482 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:36,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:36,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:36,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:36,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,484 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:36,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,484 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:36,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:36,485 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:36,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:36,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:36,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:36,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:36,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:36,488 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:36,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:36,490 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:36,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:36,491 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:36,505 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:36,505 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:36,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:36,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:36,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:36,505 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:36,505 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:36,505 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:36,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:36,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:36,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:36,506 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:36,506 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,506 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:36,506 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:36,506 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,506 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:36,506 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,506 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:36,506 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:36,506 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,506 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,506 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:36,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:36,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:36,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:36,506 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:36,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:36,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:36,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:36,506 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,507 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,558 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,595 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:12:36,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 11:12:36,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:12:36,599 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 11:12:36,602 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-14 11:12:36,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,603 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:36,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689333156278Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689333156507 (+229 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689333156508 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689333156527 (+19 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689333156546 (+19 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689333156602 (+56 ms) 2023-07-14 11:12:36,605 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 11:12:36,607 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 324 msec 2023-07-14 11:12:36,899 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:12:36,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 11:12:36,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 11:12:36,923 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:36,923 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 11:12:36,929 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:33754, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:36,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35929] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 11:12:36,936 DEBUG [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-14 11:12:36,937 DEBUG [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6. 2023-07-14 11:12:36,939 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:12:36,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 11:12:36,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689333156967 (current time:1689333156967). 2023-07-14 11:12:36,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 11:12:36,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(139): Connect 0x69347da3 to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:12:36,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a6efe75, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:12:36,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:36,983 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35360, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:36,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69347da3 to 127.0.0.1:58300 2023-07-14 11:12:36,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:12:36,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(139): Connect 0x65d6dc9e to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:12:36,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f456ce2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:12:37,096 DEBUG [hconnection-0x32c5a229-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:37,101 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:35376, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:37,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:37,110 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:46002, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:37,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65d6dc9e to 127.0.0.1:58300 2023-07-14 11:12:37,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:12:37,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-14 11:12:37,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 11:12:37,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 11:12:37,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 11:12:37,124 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 11:12:37,126 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689333757126 2023-07-14 11:12:37,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-14 11:12:37,126 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-14 11:12:37,128 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 11:12:37,128 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 11:12:37,130 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 11:12:37,130 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-14 11:12:37,135 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 10 msec 2023-07-14 11:12:37,136 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 11:12:37,142 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689333757142 2023-07-14 11:12:37,174 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-14 11:12:37,174 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-14 11:12:37,174 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:37,175 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-14 11:12:37,175 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-14 11:12:37,176 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,176 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,178 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:37,178 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:37,178 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:37,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:37,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:37,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:37,178 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:37,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:37,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:37,179 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:37,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:37,179 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:37,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,180 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:37,180 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 11:12:37,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,180 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 11:12:37,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,181 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 11:12:37,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 11:12:37,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,181 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 11:12:37,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-14 11:12:37,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,181 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-14 11:12:37,193 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 11:12:37,194 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 11:12:37,194 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:37,195 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 11:12:37,196 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 11:12:37,196 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:37,196 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-14 11:12:37,199 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 11:12:37,199 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 11:12:37,199 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 11:12:37,199 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40207,1689333142617' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 11:12:37,199 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 11:12:37,199 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35929,1689333142490' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 11:12:37,199 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-14 11:12:37,199 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:37,201 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-14 11:12:37,201 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-14 11:12:37,201 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46581,1689333142353' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-14 11:12:37,205 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,205 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:37,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:37,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:37,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:37,206 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:37,206 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,206 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:37,206 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,206 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:12:37,206 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,206 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:12:37,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:37,206 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,207 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:12:37,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 11:12:37,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:37,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:37,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:37,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:37,209 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35929,1689333142490' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-14 11:12:37,209 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74750633[Count = 1] remaining members to acquire global barrier 2023-07-14 11:12:37,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:37,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:37,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:37,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:37,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:37,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 11:12:37,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:37,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:37,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:37,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:37,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40207,1689333142617' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-14 11:12:37,213 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@74750633[Count = 0] remaining members to acquire global barrier 2023-07-14 11:12:37,213 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-14 11:12:37,213 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,217 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,217 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,218 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 11:12:37,218 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 11:12:37,218 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,218 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:12:37,218 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:12:37,218 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:12:37,218 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:12:37,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,218 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6. 2023-07-14 11:12:37,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,218 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6. started... 2023-07-14 11:12:37,219 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-14 11:12:37,219 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 11:12:37,218 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:37,218 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a. 2023-07-14 11:12:37,219 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,46581,1689333142353' in zk 2023-07-14 11:12:37,219 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a. started... 2023-07-14 11:12:37,219 INFO [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5b2ae149e90989cc8950bf5115e227b6 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-14 11:12:37,219 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:37,219 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 11:12:37,219 INFO [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 41d5e5ea7c2b721ce28b4052c3f7b73a 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-14 11:12:37,221 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 11:12:37,222 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:37,222 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 11:12:37,228 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:12:37,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 11:12:37,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:12:37,230 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 11:12:37,321 INFO [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportWithTargetName/5b2ae149e90989cc8950bf5115e227b6/.tmp/cf/97a702d4246a4c9a918230d2658a7d72 2023-07-14 11:12:37,323 INFO [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportWithTargetName/41d5e5ea7c2b721ce28b4052c3f7b73a/.tmp/cf/0a6dcd4c435f4470bc4f96019252ec86 2023-07-14 11:12:37,378 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportWithTargetName/41d5e5ea7c2b721ce28b4052c3f7b73a/.tmp/cf/0a6dcd4c435f4470bc4f96019252ec86 as hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportWithTargetName/41d5e5ea7c2b721ce28b4052c3f7b73a/cf/0a6dcd4c435f4470bc4f96019252ec86 2023-07-14 11:12:37,378 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportWithTargetName/5b2ae149e90989cc8950bf5115e227b6/.tmp/cf/97a702d4246a4c9a918230d2658a7d72 as hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportWithTargetName/5b2ae149e90989cc8950bf5115e227b6/cf/97a702d4246a4c9a918230d2658a7d72 2023-07-14 11:12:37,387 INFO [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportWithTargetName/41d5e5ea7c2b721ce28b4052c3f7b73a/cf/0a6dcd4c435f4470bc4f96019252ec86, entries=48, sequenceid=6, filesize=8.1 K 2023-07-14 11:12:37,389 INFO [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportWithTargetName/5b2ae149e90989cc8950bf5115e227b6/cf/97a702d4246a4c9a918230d2658a7d72, entries=2, sequenceid=6, filesize=5.0 K 2023-07-14 11:12:37,393 INFO [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 5b2ae149e90989cc8950bf5115e227b6 in 174ms, sequenceid=6, compaction requested=false 2023-07-14 11:12:37,393 INFO [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 41d5e5ea7c2b721ce28b4052c3f7b73a in 174ms, sequenceid=6, compaction requested=false 2023-07-14 11:12:37,393 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-14 11:12:37,393 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-14 11:12:37,395 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 41d5e5ea7c2b721ce28b4052c3f7b73a: 2023-07-14 11:12:37,395 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b2ae149e90989cc8950bf5115e227b6: 2023-07-14 11:12:37,396 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-14 11:12:37,396 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-14 11:12:37,396 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:12:37,396 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:12:37,396 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportWithTargetName/41d5e5ea7c2b721ce28b4052c3f7b73a/cf/0a6dcd4c435f4470bc4f96019252ec86] hfiles 2023-07-14 11:12:37,396 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportWithTargetName/5b2ae149e90989cc8950bf5115e227b6/cf/97a702d4246a4c9a918230d2658a7d72] hfiles 2023-07-14 11:12:37,396 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportWithTargetName/41d5e5ea7c2b721ce28b4052c3f7b73a/cf/0a6dcd4c435f4470bc4f96019252ec86 for snapshot=snaptb0-testExportWithTargetName 2023-07-14 11:12:37,396 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportWithTargetName/5b2ae149e90989cc8950bf5115e227b6/cf/97a702d4246a4c9a918230d2658a7d72 for snapshot=snaptb0-testExportWithTargetName 2023-07-14 11:12:37,426 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6. completed. 2023-07-14 11:12:37,426 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6. 2023-07-14 11:12:37,426 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:12:37,426 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:12:37,427 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:37,427 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 11:12:37,427 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,40207,1689333142617' in zk 2023-07-14 11:12:37,428 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a. completed. 2023-07-14 11:12:37,428 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a. 2023-07-14 11:12:37,428 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:12:37,428 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:12:37,428 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:37,429 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-14 11:12:37,429 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase9.apache.org,35929,1689333142490' in zk 2023-07-14 11:12:37,429 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 11:12:37,429 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:37,429 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 11:12:37,431 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:12:37,431 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:37,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:37,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:37,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:37,432 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:37,432 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-14 11:12:37,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:37,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 11:12:37,432 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:37,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:12:37,432 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-14 11:12:37,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:37,433 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 11:12:37,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 11:12:37,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:37,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:37,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:37,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:37,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 11:12:37,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:37,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:37,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:37,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,40207,1689333142617': 2023-07-14 11:12:37,437 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40207,1689333142617' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-14 11:12:37,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:37,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:37,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:37,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:37,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:37,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 11:12:37,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:37,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:37,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:37,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:37,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 11:12:37,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:37,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:37,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:37,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase9.apache.org,35929,1689333142490': 2023-07-14 11:12:37,442 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35929,1689333142490' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-14 11:12:37,442 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-14 11:12:37,442 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 11:12:37,442 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 11:12:37,442 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-14 11:12:37,442 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 11:12:37,448 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,448 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,448 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:37,448 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:37,448 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,448 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:37,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:37,449 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:37,449 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:37,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:37,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:37,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:37,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:37,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,450 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:37,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:37,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:37,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:37,450 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:37,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 11:12:37,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:37,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 11:12:37,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:37,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:37,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:37,453 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:37,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:37,453 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:37,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-14 11:12:37,454 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:37,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:37,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:37,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:37,464 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:37,465 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:37,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:37,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:37,465 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:37,465 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:37,465 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:37,464 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:37,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:37,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:37,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:37,465 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-14 11:12:37,465 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:37,466 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-14 11:12:37,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:37,465 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,466 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:37,466 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:37,466 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,466 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:37,466 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,466 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:37,466 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:37,466 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,466 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:37,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:37,466 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:37,467 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,469 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:37,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:37,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:37,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:37,591 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,660 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-14 11:12:37,660 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,660 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-14 11:12:37,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689333157126Consolidate snapshot: snaptb0-testExportWithTargetName at 1689333157466 (+340 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1689333157466Writing data manifest for snaptb0-testExportWithTargetName at 1689333157500 (+34 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689333157574 (+74 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689333157660 (+86 ms) 2023-07-14 11:12:37,664 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-14 11:12:37,667 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 537 msec 2023-07-14 11:12:37,734 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:12:37,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-14 11:12:37,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 11:12:37,739 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333157739 2023-07-14 11:12:37,739 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36847, tgtDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333157739, rawTgtDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333157739, srcFsUri=hdfs://localhost:36847, srcDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4 2023-07-14 11:12:37,839 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36847, inputRoot=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4 2023-07-14 11:12:37,840 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1938919405_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333157739, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333157739/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-14 11:12:37,840 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36847, inputRoot=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4, snapshotDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-14 11:12:37,876 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333157739/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-14 11:12:38,016 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:38,017 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:38,017 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:38,018 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:38,018 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:38,019 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:38,019 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:38,113 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/hadoop-6390226360294445748.jar 2023-07-14 11:12:38,114 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:38,115 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:38,116 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:38,116 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:38,117 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:38,117 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:38,118 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 11:12:38,119 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 11:12:38,120 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 11:12:38,121 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 11:12:38,122 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 11:12:38,123 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 11:12:38,123 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 11:12:38,124 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 11:12:38,125 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 11:12:38,137 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 11:12:38,142 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:12:38,143 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:12:38,143 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:12:38,144 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:12:38,144 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:12:38,145 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:12:38,145 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:12:40,211 WARN [Listener at jenkins-hbase9.apache.org/36907] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 11:12:40,218 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-14 11:12:40,228 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-14 11:12:40,753 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:12:40,756 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:12:40,992 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 11:12:41,033 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0001_000001 (auth:SIMPLE) 2023-07-14 11:12:47,675 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0001_000001 (auth:SIMPLE) 2023-07-14 11:12:49,967 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0001_000001 (auth:SIMPLE) 2023-07-14 11:12:53,667 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0001_000001 (auth:SIMPLE) 2023-07-14 11:12:55,199 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 11:12:55,200 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 11:12:55,210 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-14 11:12:55,210 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 11:12:55,211 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 11:12:55,211 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1095779325_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-14 11:12:55,212 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-14 11:12:55,212 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-14 11:12:55,212 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1095779325_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333157739/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333157739/.hbase-snapshot/testExportWithTargetName 2023-07-14 11:12:55,213 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333157739/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-14 11:12:55,213 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333157739/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-14 11:12:55,225 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-14 11:12:55,230 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportWithTargetName 2023-07-14 11:12:55,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-14 11:12:55,253 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333175253"}]},"ts":"1689333175253"} 2023-07-14 11:12:55,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 11:12:55,255 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-14 11:12:55,259 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-14 11:12:55,260 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b2ae149e90989cc8950bf5115e227b6, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=41d5e5ea7c2b721ce28b4052c3f7b73a, UNASSIGN}] 2023-07-14 11:12:55,263 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=41d5e5ea7c2b721ce28b4052c3f7b73a, UNASSIGN 2023-07-14 11:12:55,264 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b2ae149e90989cc8950bf5115e227b6, UNASSIGN 2023-07-14 11:12:55,265 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=41d5e5ea7c2b721ce28b4052c3f7b73a, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:55,265 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689333175264"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333175264"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333175264"}]},"ts":"1689333175264"} 2023-07-14 11:12:55,265 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5b2ae149e90989cc8950bf5115e227b6, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:55,265 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689333175265"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333175265"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333175265"}]},"ts":"1689333175265"} 2023-07-14 11:12:55,267 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE; CloseRegionProcedure 41d5e5ea7c2b721ce28b4052c3f7b73a, server=jenkins-hbase9.apache.org,35929,1689333142490}] 2023-07-14 11:12:55,269 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=22, state=RUNNABLE; CloseRegionProcedure 5b2ae149e90989cc8950bf5115e227b6, server=jenkins-hbase9.apache.org,40207,1689333142617}] 2023-07-14 11:12:55,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 11:12:55,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 41d5e5ea7c2b721ce28b4052c3f7b73a 2023-07-14 11:12:55,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 41d5e5ea7c2b721ce28b4052c3f7b73a, disabling compactions & flushes 2023-07-14 11:12:55,431 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a. 2023-07-14 11:12:55,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a. 2023-07-14 11:12:55,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a. after waiting 0 ms 2023-07-14 11:12:55,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a. 2023-07-14 11:12:55,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 5b2ae149e90989cc8950bf5115e227b6 2023-07-14 11:12:55,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 5b2ae149e90989cc8950bf5115e227b6, disabling compactions & flushes 2023-07-14 11:12:55,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6. 2023-07-14 11:12:55,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6. 2023-07-14 11:12:55,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6. after waiting 0 ms 2023-07-14 11:12:55,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6. 2023-07-14 11:12:55,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportWithTargetName/5b2ae149e90989cc8950bf5115e227b6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 11:12:55,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportWithTargetName/41d5e5ea7c2b721ce28b4052c3f7b73a/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 11:12:55,466 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:12:55,467 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:12:55,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a. 2023-07-14 11:12:55,468 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6. 2023-07-14 11:12:55,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 41d5e5ea7c2b721ce28b4052c3f7b73a: 2023-07-14 11:12:55,469 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 5b2ae149e90989cc8950bf5115e227b6: 2023-07-14 11:12:55,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 41d5e5ea7c2b721ce28b4052c3f7b73a 2023-07-14 11:12:55,472 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=41d5e5ea7c2b721ce28b4052c3f7b73a, regionState=CLOSED 2023-07-14 11:12:55,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 5b2ae149e90989cc8950bf5115e227b6 2023-07-14 11:12:55,472 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689333175472"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333175472"}]},"ts":"1689333175472"} 2023-07-14 11:12:55,473 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5b2ae149e90989cc8950bf5115e227b6, regionState=CLOSED 2023-07-14 11:12:55,473 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689333175473"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333175473"}]},"ts":"1689333175473"} 2023-07-14 11:12:55,477 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-07-14 11:12:55,477 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; CloseRegionProcedure 41d5e5ea7c2b721ce28b4052c3f7b73a, server=jenkins-hbase9.apache.org,35929,1689333142490 in 207 msec 2023-07-14 11:12:55,478 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=22 2023-07-14 11:12:55,479 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=22, state=SUCCESS; CloseRegionProcedure 5b2ae149e90989cc8950bf5115e227b6, server=jenkins-hbase9.apache.org,40207,1689333142617 in 206 msec 2023-07-14 11:12:55,480 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=41d5e5ea7c2b721ce28b4052c3f7b73a, UNASSIGN in 217 msec 2023-07-14 11:12:55,481 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-14 11:12:55,481 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5b2ae149e90989cc8950bf5115e227b6, UNASSIGN in 219 msec 2023-07-14 11:12:55,483 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333175482"}]},"ts":"1689333175482"} 2023-07-14 11:12:55,484 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-14 11:12:55,486 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-14 11:12:55,488 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 253 msec 2023-07-14 11:12:55,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-14 11:12:55,557 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-14 11:12:55,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportWithTargetName 2023-07-14 11:12:55,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 11:12:55,574 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 11:12:55,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-14 11:12:55,576 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 11:12:55,579 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46581] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-14 11:12:55,582 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 11:12:55,582 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 11:12:55,582 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 11:12:55,582 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportWithTargetName/5b2ae149e90989cc8950bf5115e227b6 2023-07-14 11:12:55,582 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportWithTargetName/41d5e5ea7c2b721ce28b4052c3f7b73a 2023-07-14 11:12:55,586 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportWithTargetName/41d5e5ea7c2b721ce28b4052c3f7b73a/cf, FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportWithTargetName/41d5e5ea7c2b721ce28b4052c3f7b73a/recovered.edits] 2023-07-14 11:12:55,586 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportWithTargetName/5b2ae149e90989cc8950bf5115e227b6/cf, FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportWithTargetName/5b2ae149e90989cc8950bf5115e227b6/recovered.edits] 2023-07-14 11:12:55,590 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:12:55,590 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-14 11:12:55,590 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:12:55,590 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-14 11:12:55,590 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 11:12:55,590 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:12:55,590 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 11:12:55,590 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-14 11:12:55,590 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 11:12:55,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-14 11:12:55,593 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-14 11:12:55,594 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:12:55,594 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportWithTargetName/41d5e5ea7c2b721ce28b4052c3f7b73a/cf/0a6dcd4c435f4470bc4f96019252ec86 to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testExportWithTargetName/41d5e5ea7c2b721ce28b4052c3f7b73a/cf/0a6dcd4c435f4470bc4f96019252ec86 2023-07-14 11:12:55,594 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportWithTargetName/5b2ae149e90989cc8950bf5115e227b6/cf/97a702d4246a4c9a918230d2658a7d72 to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testExportWithTargetName/5b2ae149e90989cc8950bf5115e227b6/cf/97a702d4246a4c9a918230d2658a7d72 2023-07-14 11:12:55,595 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-14 11:12:55,595 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 11:12:55,600 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportWithTargetName/41d5e5ea7c2b721ce28b4052c3f7b73a/recovered.edits/9.seqid to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testExportWithTargetName/41d5e5ea7c2b721ce28b4052c3f7b73a/recovered.edits/9.seqid 2023-07-14 11:12:55,601 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportWithTargetName/5b2ae149e90989cc8950bf5115e227b6/recovered.edits/9.seqid to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testExportWithTargetName/5b2ae149e90989cc8950bf5115e227b6/recovered.edits/9.seqid 2023-07-14 11:12:55,601 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportWithTargetName/41d5e5ea7c2b721ce28b4052c3f7b73a 2023-07-14 11:12:55,602 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportWithTargetName/5b2ae149e90989cc8950bf5115e227b6 2023-07-14 11:12:55,602 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-14 11:12:55,605 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 11:12:55,631 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-14 11:12:55,638 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-14 11:12:55,640 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 11:12:55,641 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-14 11:12:55,641 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689333175641"}]},"ts":"9223372036854775807"} 2023-07-14 11:12:55,641 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689333175641"}]},"ts":"9223372036854775807"} 2023-07-14 11:12:55,647 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 11:12:55,647 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5b2ae149e90989cc8950bf5115e227b6, NAME => 'testtb-testExportWithTargetName,,1689333154926.5b2ae149e90989cc8950bf5115e227b6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 41d5e5ea7c2b721ce28b4052c3f7b73a, NAME => 'testtb-testExportWithTargetName,1,1689333154926.41d5e5ea7c2b721ce28b4052c3f7b73a.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 11:12:55,647 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-14 11:12:55,648 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689333175647"}]},"ts":"9223372036854775807"} 2023-07-14 11:12:55,678 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-14 11:12:55,681 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-14 11:12:55,685 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 118 msec 2023-07-14 11:12:55,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-14 11:12:55,695 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-14 11:12:55,719 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-14 11:12:55,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-14 11:12:55,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportWithTargetName" 2023-07-14 11:12:55,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-14 11:12:55,776 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=755 (was 708) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/cluster_2a4290d5-6584-4b86-320b-63166dfccd9d/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49bc206a-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/cluster_2a4290d5-6584-4b86-320b-63166dfccd9d/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-849715450_1 at /127.0.0.1:53300 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/cluster_2a4290d5-6584-4b86-320b-63166dfccd9d/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase9.apache.org/172.31.2.10:42773 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/cluster_2a4290d5-6584-4b86-320b-63166dfccd9d/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49bc206a-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49bc206a-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1095779325_17 at /127.0.0.1:53334 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/cluster_2a4290d5-6584-4b86-320b-63166dfccd9d/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1095779325_17 at /127.0.0.1:42368 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49bc206a-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase9.apache.org/172.31.2.10:33575 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/cluster_2a4290d5-6584-4b86-320b-63166dfccd9d/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1283 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=919 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1147 (was 1241), ProcessCount=190 (was 184) - ProcessCount LEAK? -, AvailableMemoryMB=3100 (was 4742) 2023-07-14 11:12:55,776 WARN [Listener at jenkins-hbase9.apache.org/36907] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-14 11:12:55,808 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=919, MaxFileDescriptor=60000, SystemLoadAverage=1147, ProcessCount=190, AvailableMemoryMB=3099 2023-07-14 11:12:55,808 WARN [Listener at jenkins-hbase9.apache.org/36907] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-14 11:12:55,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 11:12:55,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-14 11:12:55,823 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 11:12:55,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-14 11:12:55,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 11:12:55,825 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 11:12:55,830 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemState/4173d2f017452704ed0eda610f202cc5 2023-07-14 11:12:55,830 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemState/288995a998c1c6c8788f63e043e7dfcb 2023-07-14 11:12:55,831 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemState/288995a998c1c6c8788f63e043e7dfcb empty. 2023-07-14 11:12:55,831 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemState/4173d2f017452704ed0eda610f202cc5 empty. 2023-07-14 11:12:55,831 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemState/288995a998c1c6c8788f63e043e7dfcb 2023-07-14 11:12:55,831 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemState/4173d2f017452704ed0eda610f202cc5 2023-07-14 11:12:55,832 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-14 11:12:55,867 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-14 11:12:55,870 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 288995a998c1c6c8788f63e043e7dfcb, NAME => 'testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp 2023-07-14 11:12:55,870 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4173d2f017452704ed0eda610f202cc5, NAME => 'testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp 2023-07-14 11:12:55,902 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:55,903 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 288995a998c1c6c8788f63e043e7dfcb, disabling compactions & flushes 2023-07-14 11:12:55,903 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb. 2023-07-14 11:12:55,903 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb. 2023-07-14 11:12:55,903 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb. after waiting 0 ms 2023-07-14 11:12:55,903 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb. 2023-07-14 11:12:55,903 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb. 2023-07-14 11:12:55,903 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 288995a998c1c6c8788f63e043e7dfcb: 2023-07-14 11:12:55,911 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:55,913 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 4173d2f017452704ed0eda610f202cc5, disabling compactions & flushes 2023-07-14 11:12:55,913 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5. 2023-07-14 11:12:55,913 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5. 2023-07-14 11:12:55,913 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5. after waiting 0 ms 2023-07-14 11:12:55,913 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5. 2023-07-14 11:12:55,913 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5. 2023-07-14 11:12:55,913 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 4173d2f017452704ed0eda610f202cc5: 2023-07-14 11:12:55,916 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 11:12:55,918 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689333175917"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333175917"}]},"ts":"1689333175917"} 2023-07-14 11:12:55,918 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689333175917"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333175917"}]},"ts":"1689333175917"} 2023-07-14 11:12:55,921 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 11:12:55,922 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 11:12:55,922 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333175922"}]},"ts":"1689333175922"} 2023-07-14 11:12:55,924 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-14 11:12:55,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 11:12:55,928 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 11:12:55,929 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 11:12:55,930 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 11:12:55,930 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 11:12:55,930 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 11:12:55,930 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4173d2f017452704ed0eda610f202cc5, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=288995a998c1c6c8788f63e043e7dfcb, ASSIGN}] 2023-07-14 11:12:55,933 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=288995a998c1c6c8788f63e043e7dfcb, ASSIGN 2023-07-14 11:12:55,933 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4173d2f017452704ed0eda610f202cc5, ASSIGN 2023-07-14 11:12:55,935 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4173d2f017452704ed0eda610f202cc5, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46581,1689333142353; forceNewPlan=false, retain=false 2023-07-14 11:12:55,936 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=288995a998c1c6c8788f63e043e7dfcb, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40207,1689333142617; forceNewPlan=false, retain=false 2023-07-14 11:12:56,086 INFO [jenkins-hbase9:38311] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 11:12:56,089 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=4173d2f017452704ed0eda610f202cc5, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:56,089 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=288995a998c1c6c8788f63e043e7dfcb, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:56,090 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689333176089"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333176089"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333176089"}]},"ts":"1689333176089"} 2023-07-14 11:12:56,090 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689333176089"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333176089"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333176089"}]},"ts":"1689333176089"} 2023-07-14 11:12:56,093 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 4173d2f017452704ed0eda610f202cc5, server=jenkins-hbase9.apache.org,46581,1689333142353}] 2023-07-14 11:12:56,095 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 288995a998c1c6c8788f63e043e7dfcb, server=jenkins-hbase9.apache.org,40207,1689333142617}] 2023-07-14 11:12:56,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 11:12:56,254 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5. 2023-07-14 11:12:56,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4173d2f017452704ed0eda610f202cc5, NAME => 'testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 11:12:56,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5. service=AccessControlService 2023-07-14 11:12:56,255 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:12:56,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 4173d2f017452704ed0eda610f202cc5 2023-07-14 11:12:56,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:56,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 4173d2f017452704ed0eda610f202cc5 2023-07-14 11:12:56,255 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 4173d2f017452704ed0eda610f202cc5 2023-07-14 11:12:56,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb. 2023-07-14 11:12:56,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 288995a998c1c6c8788f63e043e7dfcb, NAME => 'testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 11:12:56,256 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb. service=AccessControlService 2023-07-14 11:12:56,257 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:12:56,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 288995a998c1c6c8788f63e043e7dfcb 2023-07-14 11:12:56,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:12:56,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 288995a998c1c6c8788f63e043e7dfcb 2023-07-14 11:12:56,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 288995a998c1c6c8788f63e043e7dfcb 2023-07-14 11:12:56,258 INFO [StoreOpener-4173d2f017452704ed0eda610f202cc5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4173d2f017452704ed0eda610f202cc5 2023-07-14 11:12:56,259 INFO [StoreOpener-288995a998c1c6c8788f63e043e7dfcb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 288995a998c1c6c8788f63e043e7dfcb 2023-07-14 11:12:56,260 DEBUG [StoreOpener-4173d2f017452704ed0eda610f202cc5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemState/4173d2f017452704ed0eda610f202cc5/cf 2023-07-14 11:12:56,260 DEBUG [StoreOpener-4173d2f017452704ed0eda610f202cc5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemState/4173d2f017452704ed0eda610f202cc5/cf 2023-07-14 11:12:56,261 INFO [StoreOpener-4173d2f017452704ed0eda610f202cc5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4173d2f017452704ed0eda610f202cc5 columnFamilyName cf 2023-07-14 11:12:56,262 INFO [StoreOpener-4173d2f017452704ed0eda610f202cc5-1] regionserver.HStore(310): Store=4173d2f017452704ed0eda610f202cc5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:12:56,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemState/4173d2f017452704ed0eda610f202cc5 2023-07-14 11:12:56,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemState/4173d2f017452704ed0eda610f202cc5 2023-07-14 11:12:56,269 DEBUG [StoreOpener-288995a998c1c6c8788f63e043e7dfcb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemState/288995a998c1c6c8788f63e043e7dfcb/cf 2023-07-14 11:12:56,269 DEBUG [StoreOpener-288995a998c1c6c8788f63e043e7dfcb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemState/288995a998c1c6c8788f63e043e7dfcb/cf 2023-07-14 11:12:56,269 INFO [StoreOpener-288995a998c1c6c8788f63e043e7dfcb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 288995a998c1c6c8788f63e043e7dfcb columnFamilyName cf 2023-07-14 11:12:56,274 INFO [StoreOpener-288995a998c1c6c8788f63e043e7dfcb-1] regionserver.HStore(310): Store=288995a998c1c6c8788f63e043e7dfcb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:12:56,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemState/288995a998c1c6c8788f63e043e7dfcb 2023-07-14 11:12:56,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 4173d2f017452704ed0eda610f202cc5 2023-07-14 11:12:56,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemState/288995a998c1c6c8788f63e043e7dfcb 2023-07-14 11:12:56,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemState/4173d2f017452704ed0eda610f202cc5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:12:56,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 4173d2f017452704ed0eda610f202cc5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75225659, jitterRate=0.12094967067241669}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:12:56,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 4173d2f017452704ed0eda610f202cc5: 2023-07-14 11:12:56,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 288995a998c1c6c8788f63e043e7dfcb 2023-07-14 11:12:56,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5., pid=30, masterSystemTime=1689333176246 2023-07-14 11:12:56,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemState/288995a998c1c6c8788f63e043e7dfcb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:12:56,290 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 288995a998c1c6c8788f63e043e7dfcb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63496078, jitterRate=-0.0538347065448761}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:12:56,290 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 288995a998c1c6c8788f63e043e7dfcb: 2023-07-14 11:12:56,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5. 2023-07-14 11:12:56,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5. 2023-07-14 11:12:56,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb., pid=31, masterSystemTime=1689333176251 2023-07-14 11:12:56,292 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=4173d2f017452704ed0eda610f202cc5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:56,292 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689333176291"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333176291"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333176291"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333176291"}]},"ts":"1689333176291"} 2023-07-14 11:12:56,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb. 2023-07-14 11:12:56,294 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb. 2023-07-14 11:12:56,296 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=288995a998c1c6c8788f63e043e7dfcb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:56,298 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689333176296"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333176296"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333176296"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333176296"}]},"ts":"1689333176296"} 2023-07-14 11:12:56,301 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-14 11:12:56,301 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 4173d2f017452704ed0eda610f202cc5, server=jenkins-hbase9.apache.org,46581,1689333142353 in 202 msec 2023-07-14 11:12:56,304 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4173d2f017452704ed0eda610f202cc5, ASSIGN in 371 msec 2023-07-14 11:12:56,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-14 11:12:56,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 288995a998c1c6c8788f63e043e7dfcb, server=jenkins-hbase9.apache.org,40207,1689333142617 in 205 msec 2023-07-14 11:12:56,310 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-14 11:12:56,310 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=288995a998c1c6c8788f63e043e7dfcb, ASSIGN in 377 msec 2023-07-14 11:12:56,310 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 11:12:56,311 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333176310"}]},"ts":"1689333176310"} 2023-07-14 11:12:56,314 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-14 11:12:56,317 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 11:12:56,317 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-14 11:12:56,319 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46581] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 11:12:56,321 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:12:56,321 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:12:56,321 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:12:56,321 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:12:56,322 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 11:12:56,322 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 11:12:56,322 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 11:12:56,323 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 11:12:56,324 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 506 msec 2023-07-14 11:12:56,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-14 11:12:56,429 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-14 11:12:56,429 DEBUG [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-14 11:12:56,430 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:12:56,436 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-14 11:12:56,436 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:12:56,436 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-14 11:12:56,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 11:12:56,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689333176441 (current time:1689333176441). 2023-07-14 11:12:56,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 11:12:56,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(139): Connect 0x3a7bfbae to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:12:56,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49a397a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:12:56,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:56,454 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55706, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:56,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3a7bfbae to 127.0.0.1:58300 2023-07-14 11:12:56,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:12:56,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(139): Connect 0x2940a2af to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:12:56,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4c039aa2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:12:56,470 DEBUG [hconnection-0x19072bb1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:56,471 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55714, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:56,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:56,478 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39616, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:56,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2940a2af to 127.0.0.1:58300 2023-07-14 11:12:56,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:12:56,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 11:12:56,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 11:12:56,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 11:12:56,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 11:12:56,484 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 11:12:56,487 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689333776486 2023-07-14 11:12:56,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 11:12:56,487 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-14 11:12:56,489 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 11:12:56,494 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 11:12:56,494 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 11:12:56,496 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 11:12:56,505 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 14 msec 2023-07-14 11:12:56,506 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 11:12:56,507 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689333776507 2023-07-14 11:12:56,525 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,525 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-14 11:12:56,525 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:56,527 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-14 11:12:56,527 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-14 11:12:56,528 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,528 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,529 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:56,529 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:56,530 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:56,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:56,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:56,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:56,530 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:56,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:56,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:56,530 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:56,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,531 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:56,531 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:56,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,531 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:56,531 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 11:12:56,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 11:12:56,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 11:12:56,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-14 11:12:56,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,532 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 11:12:56,532 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 11:12:56,532 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 11:12:56,532 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,532 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 11:12:56,532 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:56,532 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,532 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 11:12:56,532 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:56,534 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 11:12:56,535 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 11:12:56,535 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 11:12:56,535 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 11:12:56,534 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,535 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40207,1689333142617' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 11:12:56,535 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 11:12:56,535 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46581,1689333142353' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 11:12:56,535 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:56,537 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 11:12:56,537 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-14 11:12:56,537 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35929,1689333142490' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-14 11:12:56,539 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,539 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:56,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:56,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:56,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:56,543 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:56,543 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:56,543 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,543 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:12:56,543 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:56,544 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,544 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,544 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:12:56,544 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:12:56,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:56,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:56,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:56,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:56,546 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40207,1689333142617' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-14 11:12:56,546 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@204bec2[Count = 1] remaining members to acquire global barrier 2023-07-14 11:12:56,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:56,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:56,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:56,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:56,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:56,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:56,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:56,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:56,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:56,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46581,1689333142353' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-14 11:12:56,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@204bec2[Count = 0] remaining members to acquire global barrier 2023-07-14 11:12:56,550 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 11:12:56,550 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,551 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,551 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,551 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,552 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:56,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,552 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 11:12:56,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,552 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:12:56,552 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:12:56,552 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb. 2023-07-14 11:12:56,552 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb. started... 2023-07-14 11:12:56,552 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:56,552 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 11:12:56,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,552 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 11:12:56,554 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 11:12:56,554 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,35929,1689333142490' in zk 2023-07-14 11:12:56,554 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 11:12:56,554 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:12:56,554 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 288995a998c1c6c8788f63e043e7dfcb: 2023-07-14 11:12:56,554 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:12:56,555 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5. 2023-07-14 11:12:56,555 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,555 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5. started... 2023-07-14 11:12:56,555 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:12:56,555 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 11:12:56,556 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4173d2f017452704ed0eda610f202cc5: 2023-07-14 11:12:56,557 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 11:12:56,557 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,557 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:56,557 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:12:56,557 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 11:12:56,559 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 11:12:56,585 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb. completed. 2023-07-14 11:12:56,589 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb. 2023-07-14 11:12:56,589 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:12:56,589 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:12:56,589 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:56,589 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 11:12:56,589 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,40207,1689333142617' in zk 2023-07-14 11:12:56,591 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:56,591 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 11:12:56,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:56,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:56,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:56,591 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:56,592 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 11:12:56,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:56,593 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5. completed. 2023-07-14 11:12:56,593 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5. 2023-07-14 11:12:56,593 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:12:56,593 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:12:56,593 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:56,593 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-14 11:12:56,593 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,46581,1689333142353' in zk 2023-07-14 11:12:56,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:56,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,594 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:12:56,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 11:12:56,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:12:56,596 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 11:12:56,600 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 11:12:56,600 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:56,600 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:56,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:56,600 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-14 11:12:56,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:56,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:56,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:56,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:56,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:56,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:56,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,40207,1689333142617': 2023-07-14 11:12:56,603 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40207,1689333142617' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 11:12:56,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:56,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:56,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:56,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:56,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:56,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:56,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:56,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:56,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:56,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:56,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:56,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:56,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,46581,1689333142353': 2023-07-14 11:12:56,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46581,1689333142353' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 11:12:56,607 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-14 11:12:56,607 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 11:12:56,607 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 11:12:56,607 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,607 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 11:12:56,609 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,609 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,609 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:56,609 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:56,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:56,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,610 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:56,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,610 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:56,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,610 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:56,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:56,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:56,610 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:56,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:56,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:56,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,611 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:56,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:56,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:56,612 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:56,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,612 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:56,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:56,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:56,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:56,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:56,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,615 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:56,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:56,615 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:56,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:56,616 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:56,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:56,619 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:56,619 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:56,619 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:56,619 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:56,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:56,619 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:56,619 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:56,619 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:56,619 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:56,619 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,619 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:56,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:56,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:56,619 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:56,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:56,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:56,619 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,619 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:56,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:56,621 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:56,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:56,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:56,621 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:56,621 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,621 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:56,621 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:56,621 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,621 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:56,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:56,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,649 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,688 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-14 11:12:56,688 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,689 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-14 11:12:56,689 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689333176487Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689333176619 (+132 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689333176621 (+2 ms)Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689333176626 (+5 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689333176638 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689333176688 (+50 ms) 2023-07-14 11:12:56,692 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 11:12:56,694 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 204 msec 2023-07-14 11:12:56,800 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:12:56,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 11:12:56,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 11:12:56,811 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:56,815 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39624, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:56,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46581] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 11:12:56,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 11:12:56,826 DEBUG [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-14 11:12:56,827 DEBUG [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5. 2023-07-14 11:12:56,828 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:12:56,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 11:12:56,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689333176843 (current time:1689333176843). 2023-07-14 11:12:56,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 11:12:56,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(139): Connect 0x55ac84fe to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:12:56,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@116d1eda, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:12:56,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:56,858 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:56,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x55ac84fe to 127.0.0.1:58300 2023-07-14 11:12:56,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:12:56,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(139): Connect 0x73cd8085 to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:12:56,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b953c3c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:12:56,972 DEBUG [hconnection-0x3216e82f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:56,977 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:55734, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:56,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:12:56,984 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39638, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:12:56,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x73cd8085 to 127.0.0.1:58300 2023-07-14 11:12:56,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:12:56,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 11:12:56,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 11:12:56,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 11:12:56,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 11:12:56,991 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 11:12:56,992 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689333776992 2023-07-14 11:12:56,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 11:12:56,992 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-14 11:12:56,992 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 11:12:56,992 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 11:12:56,997 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-14 11:12:56,998 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 11:12:56,999 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-14 11:12:57,002 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 11:12:57,005 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689333777005 2023-07-14 11:12:57,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-14 11:12:57,021 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-14 11:12:57,021 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:57,023 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-14 11:12:57,023 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-14 11:12:57,023 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,023 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,025 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:57,025 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:57,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:57,025 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:57,025 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:57,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:57,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:57,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:57,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:57,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:57,025 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:57,025 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:57,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,026 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,026 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:57,026 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 11:12:57,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,026 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 11:12:57,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,026 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,026 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 11:12:57,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 11:12:57,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,027 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 11:12:57,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-14 11:12:57,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,027 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-14 11:12:57,027 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 11:12:57,027 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 11:12:57,027 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-14 11:12:57,028 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 11:12:57,028 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 11:12:57,028 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:57,028 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:57,029 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 11:12:57,030 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 11:12:57,030 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 11:12:57,027 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-14 11:12:57,030 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35929,1689333142490' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 11:12:57,030 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 11:12:57,030 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46581,1689333142353' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 11:12:57,030 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:12:57,031 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-14 11:12:57,031 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-14 11:12:57,031 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40207,1689333142617' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-14 11:12:57,033 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,033 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:57,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:57,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:57,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:57,034 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,034 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:57,034 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,035 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:12:57,035 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,035 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,035 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:12:57,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:57,035 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,035 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:12:57,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:57,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 11:12:57,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:57,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:57,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:57,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:57,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46581,1689333142353' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-14 11:12:57,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22dcadb4[Count = 1] remaining members to acquire global barrier 2023-07-14 11:12:57,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:57,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:57,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:57,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:57,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:57,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 11:12:57,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:57,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:57,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:57,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:57,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40207,1689333142617' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-14 11:12:57,042 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22dcadb4[Count = 0] remaining members to acquire global barrier 2023-07-14 11:12:57,042 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 11:12:57,042 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,044 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,044 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,044 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,044 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 11:12:57,044 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:57,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,044 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:12:57,044 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:12:57,044 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb. 2023-07-14 11:12:57,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,044 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb. started... 2023-07-14 11:12:57,045 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:57,045 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 11:12:57,044 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 11:12:57,044 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-14 11:12:57,045 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 11:12:57,045 INFO [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 288995a998c1c6c8788f63e043e7dfcb 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-14 11:12:57,045 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:12:57,045 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:12:57,045 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,35929,1689333142490' in zk 2023-07-14 11:12:57,045 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5. 2023-07-14 11:12:57,045 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5. started... 2023-07-14 11:12:57,046 INFO [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4173d2f017452704ed0eda610f202cc5 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-14 11:12:57,048 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 11:12:57,048 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:57,048 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 11:12:57,093 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:12:57,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 11:12:57,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:12:57,101 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 11:12:57,103 INFO [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemState/288995a998c1c6c8788f63e043e7dfcb/.tmp/cf/805ae48ae7744b34bfbf25902b1312e2 2023-07-14 11:12:57,104 INFO [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemState/4173d2f017452704ed0eda610f202cc5/.tmp/cf/0dbc074dda8d4389bfee6151fc0ade38 2023-07-14 11:12:57,120 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemState/288995a998c1c6c8788f63e043e7dfcb/.tmp/cf/805ae48ae7744b34bfbf25902b1312e2 as hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemState/288995a998c1c6c8788f63e043e7dfcb/cf/805ae48ae7744b34bfbf25902b1312e2 2023-07-14 11:12:57,121 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemState/4173d2f017452704ed0eda610f202cc5/.tmp/cf/0dbc074dda8d4389bfee6151fc0ade38 as hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemState/4173d2f017452704ed0eda610f202cc5/cf/0dbc074dda8d4389bfee6151fc0ade38 2023-07-14 11:12:57,128 INFO [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemState/288995a998c1c6c8788f63e043e7dfcb/cf/805ae48ae7744b34bfbf25902b1312e2, entries=47, sequenceid=6, filesize=8.0 K 2023-07-14 11:12:57,131 INFO [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 288995a998c1c6c8788f63e043e7dfcb in 86ms, sequenceid=6, compaction requested=false 2023-07-14 11:12:57,132 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-14 11:12:57,133 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 288995a998c1c6c8788f63e043e7dfcb: 2023-07-14 11:12:57,133 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-14 11:12:57,133 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:12:57,133 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemState/288995a998c1c6c8788f63e043e7dfcb/cf/805ae48ae7744b34bfbf25902b1312e2] hfiles 2023-07-14 11:12:57,133 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemState/288995a998c1c6c8788f63e043e7dfcb/cf/805ae48ae7744b34bfbf25902b1312e2 for snapshot=snaptb0-testExportFileSystemState 2023-07-14 11:12:57,136 INFO [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemState/4173d2f017452704ed0eda610f202cc5/cf/0dbc074dda8d4389bfee6151fc0ade38, entries=3, sequenceid=6, filesize=5.0 K 2023-07-14 11:12:57,140 INFO [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 4173d2f017452704ed0eda610f202cc5 in 94ms, sequenceid=6, compaction requested=false 2023-07-14 11:12:57,142 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4173d2f017452704ed0eda610f202cc5: 2023-07-14 11:12:57,142 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-14 11:12:57,142 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:12:57,142 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemState/4173d2f017452704ed0eda610f202cc5/cf/0dbc074dda8d4389bfee6151fc0ade38] hfiles 2023-07-14 11:12:57,142 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemState/4173d2f017452704ed0eda610f202cc5/cf/0dbc074dda8d4389bfee6151fc0ade38 for snapshot=snaptb0-testExportFileSystemState 2023-07-14 11:12:57,174 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5. completed. 2023-07-14 11:12:57,174 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5. 2023-07-14 11:12:57,174 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:12:57,174 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:12:57,174 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:57,174 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 11:12:57,174 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,46581,1689333142353' in zk 2023-07-14 11:12:57,181 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 11:12:57,181 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:57,181 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:57,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:57,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:57,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:57,181 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 11:12:57,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:57,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:57,183 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb. completed. 2023-07-14 11:12:57,183 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb. 2023-07-14 11:12:57,183 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:12:57,183 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:12:57,183 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:57,184 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-14 11:12:57,184 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,40207,1689333142617' in zk 2023-07-14 11:12:57,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 11:12:57,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:57,185 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:57,185 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-14 11:12:57,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:57,185 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:57,186 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-14 11:12:57,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:57,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:57,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 11:12:57,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:57,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:57,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:57,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,46581,1689333142353': 2023-07-14 11:12:57,189 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46581,1689333142353' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 11:12:57,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:57,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:57,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:57,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:57,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:57,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 11:12:57,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:57,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:57,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:57,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:57,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 11:12:57,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:57,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:57,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:57,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase9.apache.org,40207,1689333142617': 2023-07-14 11:12:57,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40207,1689333142617' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 11:12:57,192 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-14 11:12:57,193 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 11:12:57,193 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 11:12:57,193 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-14 11:12:57,193 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 11:12:57,194 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,194 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:12:57,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:12:57,194 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:57,194 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,194 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,195 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:57,195 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:57,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:57,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:12:57,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,195 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:57,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:57,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:57,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:57,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 11:12:57,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:57,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,196 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:57,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:57,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:12:57,196 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:57,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 11:12:57,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:57,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:57,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:57,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:12:57,199 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:57,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-14 11:12:57,199 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:57,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:57,199 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:57,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:57,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:57,206 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:57,206 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,206 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:57,206 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:57,206 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:57,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:57,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:57,206 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:57,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:57,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:57,206 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:57,206 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:12:57,206 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-14 11:12:57,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-14 11:12:57,206 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:57,206 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:12:57,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:57,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:12:57,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:12:57,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:57,207 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:12:57,207 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,208 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:12:57,208 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,208 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:12:57,208 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:12:57,208 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,208 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:57,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:57,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:12:57,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:12:57,208 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,227 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,247 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-14 11:12:57,247 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,247 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,247 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689333176992Consolidate snapshot: snaptb0-testExportFileSystemState at 1689333177206 (+214 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1689333177207 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemState at 1689333177211 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689333177220 (+9 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689333177247 (+27 ms) 2023-07-14 11:12:57,250 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-14 11:12:57,255 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 254 msec 2023-07-14 11:12:57,301 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:12:57,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 11:12:57,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 11:12:57,306 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333177306 2023-07-14 11:12:57,307 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36847, tgtDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333177306, rawTgtDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333177306, srcFsUri=hdfs://localhost:36847, srcDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4 2023-07-14 11:12:57,329 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36847, inputRoot=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4 2023-07-14 11:12:57,330 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_23653607_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333177306, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333177306/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,330 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36847, inputRoot=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4, snapshotDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-14 11:12:57,342 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333177306/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-14 11:12:57,368 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:57,368 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:57,369 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:57,369 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:57,370 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:57,370 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:57,370 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:57,444 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/hadoop-304987885845342212.jar 2023-07-14 11:12:57,444 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:57,445 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:57,446 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:57,446 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:57,447 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:57,447 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 11:12:57,448 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 11:12:57,448 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 11:12:57,449 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 11:12:57,449 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 11:12:57,450 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 11:12:57,450 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 11:12:57,451 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 11:12:57,451 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 11:12:57,451 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 11:12:57,452 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 11:12:57,452 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:12:57,453 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:12:57,453 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:12:57,453 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:12:57,454 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:12:57,454 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:12:57,454 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:12:58,902 WARN [Listener at jenkins-hbase9.apache.org/36907] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 11:12:58,905 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-14 11:12:58,908 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-14 11:12:59,887 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:12:59,888 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:12:59,896 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0001_000001 (auth:SIMPLE) 2023-07-14 11:13:00,265 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0002_000001 (auth:SIMPLE) 2023-07-14 11:13:01,090 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 11:13:06,379 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0002_000001 (auth:SIMPLE) 2023-07-14 11:13:08,702 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0002_000001 (auth:SIMPLE) 2023-07-14 11:13:13,036 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0002_000001 (auth:SIMPLE) 2023-07-14 11:13:14,160 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 11:13:14,164 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 11:13:14,175 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-14 11:13:14,175 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 11:13:14,176 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 11:13:14,176 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1095779325_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 11:13:14,176 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-14 11:13:14,177 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-14 11:13:14,177 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1095779325_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333177306/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333177306/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-14 11:13:14,177 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333177306/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-14 11:13:14,178 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333177306/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-14 11:13:14,189 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-14 11:13:14,189 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemState 2023-07-14 11:13:14,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-14 11:13:14,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 11:13:14,200 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333194200"}]},"ts":"1689333194200"} 2023-07-14 11:13:14,202 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-14 11:13:14,204 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-14 11:13:14,205 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4173d2f017452704ed0eda610f202cc5, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=288995a998c1c6c8788f63e043e7dfcb, UNASSIGN}] 2023-07-14 11:13:14,209 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4173d2f017452704ed0eda610f202cc5, UNASSIGN 2023-07-14 11:13:14,210 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=288995a998c1c6c8788f63e043e7dfcb, UNASSIGN 2023-07-14 11:13:14,210 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=288995a998c1c6c8788f63e043e7dfcb, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:14,211 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=4173d2f017452704ed0eda610f202cc5, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:14,211 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689333194210"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333194210"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333194210"}]},"ts":"1689333194210"} 2023-07-14 11:13:14,211 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689333194210"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333194210"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333194210"}]},"ts":"1689333194210"} 2023-07-14 11:13:14,213 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=38, state=RUNNABLE; CloseRegionProcedure 288995a998c1c6c8788f63e043e7dfcb, server=jenkins-hbase9.apache.org,40207,1689333142617}] 2023-07-14 11:13:14,214 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=37, state=RUNNABLE; CloseRegionProcedure 4173d2f017452704ed0eda610f202cc5, server=jenkins-hbase9.apache.org,46581,1689333142353}] 2023-07-14 11:13:14,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 11:13:14,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 288995a998c1c6c8788f63e043e7dfcb 2023-07-14 11:13:14,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 4173d2f017452704ed0eda610f202cc5 2023-07-14 11:13:14,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 288995a998c1c6c8788f63e043e7dfcb, disabling compactions & flushes 2023-07-14 11:13:14,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 4173d2f017452704ed0eda610f202cc5, disabling compactions & flushes 2023-07-14 11:13:14,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb. 2023-07-14 11:13:14,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5. 2023-07-14 11:13:14,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb. 2023-07-14 11:13:14,370 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5. 2023-07-14 11:13:14,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb. after waiting 0 ms 2023-07-14 11:13:14,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5. after waiting 0 ms 2023-07-14 11:13:14,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb. 2023-07-14 11:13:14,371 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5. 2023-07-14 11:13:14,402 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemState/4173d2f017452704ed0eda610f202cc5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 11:13:14,403 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemState/288995a998c1c6c8788f63e043e7dfcb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 11:13:14,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:13:14,437 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5. 2023-07-14 11:13:14,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:13:14,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 4173d2f017452704ed0eda610f202cc5: 2023-07-14 11:13:14,439 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb. 2023-07-14 11:13:14,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 288995a998c1c6c8788f63e043e7dfcb: 2023-07-14 11:13:14,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 4173d2f017452704ed0eda610f202cc5 2023-07-14 11:13:14,441 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=4173d2f017452704ed0eda610f202cc5, regionState=CLOSED 2023-07-14 11:13:14,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 288995a998c1c6c8788f63e043e7dfcb 2023-07-14 11:13:14,441 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689333194441"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333194441"}]},"ts":"1689333194441"} 2023-07-14 11:13:14,442 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=288995a998c1c6c8788f63e043e7dfcb, regionState=CLOSED 2023-07-14 11:13:14,442 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689333194442"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333194442"}]},"ts":"1689333194442"} 2023-07-14 11:13:14,446 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=37 2023-07-14 11:13:14,446 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=37, state=SUCCESS; CloseRegionProcedure 4173d2f017452704ed0eda610f202cc5, server=jenkins-hbase9.apache.org,46581,1689333142353 in 229 msec 2023-07-14 11:13:14,447 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=38 2023-07-14 11:13:14,447 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=38, state=SUCCESS; CloseRegionProcedure 288995a998c1c6c8788f63e043e7dfcb, server=jenkins-hbase9.apache.org,40207,1689333142617 in 231 msec 2023-07-14 11:13:14,448 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=4173d2f017452704ed0eda610f202cc5, UNASSIGN in 241 msec 2023-07-14 11:13:14,449 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-14 11:13:14,449 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=288995a998c1c6c8788f63e043e7dfcb, UNASSIGN in 242 msec 2023-07-14 11:13:14,451 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333194451"}]},"ts":"1689333194451"} 2023-07-14 11:13:14,454 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-14 11:13:14,457 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-14 11:13:14,462 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 269 msec 2023-07-14 11:13:14,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-14 11:13:14,503 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-14 11:13:14,504 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemState 2023-07-14 11:13:14,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 11:13:14,508 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 11:13:14,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-14 11:13:14,510 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 11:13:14,511 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46581] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-14 11:13:14,519 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 11:13:14,519 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 11:13:14,519 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 11:13:14,519 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 11:13:14,520 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 11:13:14,520 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 11:13:14,520 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 11:13:14,520 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-14 11:13:14,521 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 11:13:14,521 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 11:13:14,521 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:13:14,521 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 11:13:14,521 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:13:14,521 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemState/4173d2f017452704ed0eda610f202cc5 2023-07-14 11:13:14,521 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemState/288995a998c1c6c8788f63e043e7dfcb 2023-07-14 11:13:14,521 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:13:14,521 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-14 11:13:14,522 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:13:14,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-14 11:13:14,528 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemState/288995a998c1c6c8788f63e043e7dfcb/cf, FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemState/288995a998c1c6c8788f63e043e7dfcb/recovered.edits] 2023-07-14 11:13:14,528 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemState/4173d2f017452704ed0eda610f202cc5/cf, FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemState/4173d2f017452704ed0eda610f202cc5/recovered.edits] 2023-07-14 11:13:14,536 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemState/288995a998c1c6c8788f63e043e7dfcb/cf/805ae48ae7744b34bfbf25902b1312e2 to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testExportFileSystemState/288995a998c1c6c8788f63e043e7dfcb/cf/805ae48ae7744b34bfbf25902b1312e2 2023-07-14 11:13:14,537 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemState/4173d2f017452704ed0eda610f202cc5/cf/0dbc074dda8d4389bfee6151fc0ade38 to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testExportFileSystemState/4173d2f017452704ed0eda610f202cc5/cf/0dbc074dda8d4389bfee6151fc0ade38 2023-07-14 11:13:14,544 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemState/288995a998c1c6c8788f63e043e7dfcb/recovered.edits/9.seqid to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testExportFileSystemState/288995a998c1c6c8788f63e043e7dfcb/recovered.edits/9.seqid 2023-07-14 11:13:14,545 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemState/288995a998c1c6c8788f63e043e7dfcb 2023-07-14 11:13:14,548 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemState/4173d2f017452704ed0eda610f202cc5/recovered.edits/9.seqid to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testExportFileSystemState/4173d2f017452704ed0eda610f202cc5/recovered.edits/9.seqid 2023-07-14 11:13:14,549 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemState/4173d2f017452704ed0eda610f202cc5 2023-07-14 11:13:14,550 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-14 11:13:14,554 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 11:13:14,557 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-14 11:13:14,560 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-14 11:13:14,562 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 11:13:14,562 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-14 11:13:14,562 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689333194562"}]},"ts":"9223372036854775807"} 2023-07-14 11:13:14,562 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689333194562"}]},"ts":"9223372036854775807"} 2023-07-14 11:13:14,566 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 11:13:14,566 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4173d2f017452704ed0eda610f202cc5, NAME => 'testtb-testExportFileSystemState,,1689333175814.4173d2f017452704ed0eda610f202cc5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 288995a998c1c6c8788f63e043e7dfcb, NAME => 'testtb-testExportFileSystemState,1,1689333175814.288995a998c1c6c8788f63e043e7dfcb.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 11:13:14,566 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-14 11:13:14,566 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689333194566"}]},"ts":"9223372036854775807"} 2023-07-14 11:13:14,569 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-14 11:13:14,571 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-14 11:13:14,573 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 67 msec 2023-07-14 11:13:14,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-14 11:13:14,624 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-14 11:13:14,633 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-14 11:13:14,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-14 11:13:14,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemState" 2023-07-14 11:13:14,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-14 11:13:14,671 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=766 (was 755) Potentially hanging thread: hconnection-0x49bc206a-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49bc206a-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49bc206a-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1095779325_17 at /127.0.0.1:48664 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49bc206a-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1095779325_17 at /127.0.0.1:46992 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1387554600_1 at /127.0.0.1:48640 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase9.apache.org/172.31.2.10:35159 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase9.apache.org/172.31.2.10:36907 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1948 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1095779325_17 at /127.0.0.1:46710 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=937 (was 919) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=968 (was 1147), ProcessCount=190 (was 190), AvailableMemoryMB=2439 (was 3099) 2023-07-14 11:13:14,672 WARN [Listener at jenkins-hbase9.apache.org/36907] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-14 11:13:14,700 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=766, OpenFileDescriptor=937, MaxFileDescriptor=60000, SystemLoadAverage=968, ProcessCount=190, AvailableMemoryMB=2434 2023-07-14 11:13:14,700 WARN [Listener at jenkins-hbase9.apache.org/36907] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-14 11:13:14,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 11:13:14,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-14 11:13:14,708 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 11:13:14,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-14 11:13:14,709 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 11:13:14,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 11:13:14,712 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testConsecutiveExports/0ede94d10228021699025eb588f403a4 2023-07-14 11:13:14,718 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testConsecutiveExports/0ede94d10228021699025eb588f403a4 empty. 2023-07-14 11:13:14,718 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testConsecutiveExports/bda374fe2ffd3ea9d290b1076dc33a74 2023-07-14 11:13:14,719 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testConsecutiveExports/0ede94d10228021699025eb588f403a4 2023-07-14 11:13:14,719 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testConsecutiveExports/bda374fe2ffd3ea9d290b1076dc33a74 empty. 2023-07-14 11:13:14,720 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testConsecutiveExports/bda374fe2ffd3ea9d290b1076dc33a74 2023-07-14 11:13:14,720 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-14 11:13:14,745 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-14 11:13:14,746 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0ede94d10228021699025eb588f403a4, NAME => 'testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp 2023-07-14 11:13:14,747 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => bda374fe2ffd3ea9d290b1076dc33a74, NAME => 'testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp 2023-07-14 11:13:14,763 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:13:14,763 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing bda374fe2ffd3ea9d290b1076dc33a74, disabling compactions & flushes 2023-07-14 11:13:14,763 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74. 2023-07-14 11:13:14,763 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74. 2023-07-14 11:13:14,763 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74. after waiting 0 ms 2023-07-14 11:13:14,763 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:13:14,763 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74. 2023-07-14 11:13:14,763 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 0ede94d10228021699025eb588f403a4, disabling compactions & flushes 2023-07-14 11:13:14,763 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74. 2023-07-14 11:13:14,763 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4. 2023-07-14 11:13:14,763 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for bda374fe2ffd3ea9d290b1076dc33a74: 2023-07-14 11:13:14,764 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4. 2023-07-14 11:13:14,764 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4. after waiting 0 ms 2023-07-14 11:13:14,764 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4. 2023-07-14 11:13:14,764 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4. 2023-07-14 11:13:14,764 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 0ede94d10228021699025eb588f403a4: 2023-07-14 11:13:14,775 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 11:13:14,776 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689333194775"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333194775"}]},"ts":"1689333194775"} 2023-07-14 11:13:14,776 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689333194775"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333194775"}]},"ts":"1689333194775"} 2023-07-14 11:13:14,778 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 11:13:14,781 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 11:13:14,781 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333194781"}]},"ts":"1689333194781"} 2023-07-14 11:13:14,783 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-14 11:13:14,793 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 11:13:14,794 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 11:13:14,794 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 11:13:14,794 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 11:13:14,794 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 11:13:14,795 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0ede94d10228021699025eb588f403a4, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bda374fe2ffd3ea9d290b1076dc33a74, ASSIGN}] 2023-07-14 11:13:14,799 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bda374fe2ffd3ea9d290b1076dc33a74, ASSIGN 2023-07-14 11:13:14,799 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0ede94d10228021699025eb588f403a4, ASSIGN 2023-07-14 11:13:14,802 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bda374fe2ffd3ea9d290b1076dc33a74, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35929,1689333142490; forceNewPlan=false, retain=false 2023-07-14 11:13:14,802 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0ede94d10228021699025eb588f403a4, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40207,1689333142617; forceNewPlan=false, retain=false 2023-07-14 11:13:14,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 11:13:14,952 INFO [jenkins-hbase9:38311] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 11:13:14,955 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=0ede94d10228021699025eb588f403a4, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:14,955 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=bda374fe2ffd3ea9d290b1076dc33a74, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:14,955 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689333194955"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333194955"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333194955"}]},"ts":"1689333194955"} 2023-07-14 11:13:14,955 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689333194955"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333194955"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333194955"}]},"ts":"1689333194955"} 2023-07-14 11:13:14,958 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 0ede94d10228021699025eb588f403a4, server=jenkins-hbase9.apache.org,40207,1689333142617}] 2023-07-14 11:13:14,959 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure bda374fe2ffd3ea9d290b1076dc33a74, server=jenkins-hbase9.apache.org,35929,1689333142490}] 2023-07-14 11:13:15,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 11:13:15,125 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4. 2023-07-14 11:13:15,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74. 2023-07-14 11:13:15,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0ede94d10228021699025eb588f403a4, NAME => 'testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 11:13:15,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bda374fe2ffd3ea9d290b1076dc33a74, NAME => 'testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 11:13:15,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74. service=AccessControlService 2023-07-14 11:13:15,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4. service=AccessControlService 2023-07-14 11:13:15,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:13:15,126 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:13:15,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 0ede94d10228021699025eb588f403a4 2023-07-14 11:13:15,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports bda374fe2ffd3ea9d290b1076dc33a74 2023-07-14 11:13:15,126 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:13:15,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:13:15,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 0ede94d10228021699025eb588f403a4 2023-07-14 11:13:15,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for bda374fe2ffd3ea9d290b1076dc33a74 2023-07-14 11:13:15,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 0ede94d10228021699025eb588f403a4 2023-07-14 11:13:15,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for bda374fe2ffd3ea9d290b1076dc33a74 2023-07-14 11:13:15,128 INFO [StoreOpener-0ede94d10228021699025eb588f403a4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0ede94d10228021699025eb588f403a4 2023-07-14 11:13:15,128 INFO [StoreOpener-bda374fe2ffd3ea9d290b1076dc33a74-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bda374fe2ffd3ea9d290b1076dc33a74 2023-07-14 11:13:15,130 DEBUG [StoreOpener-0ede94d10228021699025eb588f403a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testConsecutiveExports/0ede94d10228021699025eb588f403a4/cf 2023-07-14 11:13:15,130 DEBUG [StoreOpener-bda374fe2ffd3ea9d290b1076dc33a74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testConsecutiveExports/bda374fe2ffd3ea9d290b1076dc33a74/cf 2023-07-14 11:13:15,130 DEBUG [StoreOpener-0ede94d10228021699025eb588f403a4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testConsecutiveExports/0ede94d10228021699025eb588f403a4/cf 2023-07-14 11:13:15,130 DEBUG [StoreOpener-bda374fe2ffd3ea9d290b1076dc33a74-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testConsecutiveExports/bda374fe2ffd3ea9d290b1076dc33a74/cf 2023-07-14 11:13:15,131 INFO [StoreOpener-bda374fe2ffd3ea9d290b1076dc33a74-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bda374fe2ffd3ea9d290b1076dc33a74 columnFamilyName cf 2023-07-14 11:13:15,131 INFO [StoreOpener-0ede94d10228021699025eb588f403a4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ede94d10228021699025eb588f403a4 columnFamilyName cf 2023-07-14 11:13:15,131 INFO [StoreOpener-0ede94d10228021699025eb588f403a4-1] regionserver.HStore(310): Store=0ede94d10228021699025eb588f403a4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:13:15,131 INFO [StoreOpener-bda374fe2ffd3ea9d290b1076dc33a74-1] regionserver.HStore(310): Store=bda374fe2ffd3ea9d290b1076dc33a74/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:13:15,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testConsecutiveExports/bda374fe2ffd3ea9d290b1076dc33a74 2023-07-14 11:13:15,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testConsecutiveExports/0ede94d10228021699025eb588f403a4 2023-07-14 11:13:15,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testConsecutiveExports/bda374fe2ffd3ea9d290b1076dc33a74 2023-07-14 11:13:15,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testConsecutiveExports/0ede94d10228021699025eb588f403a4 2023-07-14 11:13:15,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for bda374fe2ffd3ea9d290b1076dc33a74 2023-07-14 11:13:15,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 0ede94d10228021699025eb588f403a4 2023-07-14 11:13:15,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testConsecutiveExports/bda374fe2ffd3ea9d290b1076dc33a74/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:13:15,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testConsecutiveExports/0ede94d10228021699025eb588f403a4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:13:15,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 0ede94d10228021699025eb588f403a4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64429386, jitterRate=-0.03992733359336853}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:13:15,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 0ede94d10228021699025eb588f403a4: 2023-07-14 11:13:15,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened bda374fe2ffd3ea9d290b1076dc33a74; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69906611, jitterRate=0.0416896790266037}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:13:15,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for bda374fe2ffd3ea9d290b1076dc33a74: 2023-07-14 11:13:15,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4., pid=45, masterSystemTime=1689333195117 2023-07-14 11:13:15,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74., pid=46, masterSystemTime=1689333195116 2023-07-14 11:13:15,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4. 2023-07-14 11:13:15,143 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4. 2023-07-14 11:13:15,143 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=0ede94d10228021699025eb588f403a4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:15,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74. 2023-07-14 11:13:15,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74. 2023-07-14 11:13:15,144 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689333195143"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333195143"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333195143"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333195143"}]},"ts":"1689333195143"} 2023-07-14 11:13:15,144 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=bda374fe2ffd3ea9d290b1076dc33a74, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:15,144 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689333195144"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333195144"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333195144"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333195144"}]},"ts":"1689333195144"} 2023-07-14 11:13:15,148 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-14 11:13:15,148 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 0ede94d10228021699025eb588f403a4, server=jenkins-hbase9.apache.org,40207,1689333142617 in 187 msec 2023-07-14 11:13:15,148 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-14 11:13:15,148 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure bda374fe2ffd3ea9d290b1076dc33a74, server=jenkins-hbase9.apache.org,35929,1689333142490 in 187 msec 2023-07-14 11:13:15,149 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0ede94d10228021699025eb588f403a4, ASSIGN in 353 msec 2023-07-14 11:13:15,151 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=42 2023-07-14 11:13:15,151 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bda374fe2ffd3ea9d290b1076dc33a74, ASSIGN in 353 msec 2023-07-14 11:13:15,152 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 11:13:15,152 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333195152"}]},"ts":"1689333195152"} 2023-07-14 11:13:15,154 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-14 11:13:15,156 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 11:13:15,157 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-14 11:13:15,159 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46581] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 11:13:15,160 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:13:15,160 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:13:15,160 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:13:15,160 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:13:15,163 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 11:13:15,163 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 11:13:15,164 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 11:13:15,164 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-14 11:13:15,170 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 460 msec 2023-07-14 11:13:15,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-14 11:13:15,314 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-14 11:13:15,314 DEBUG [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-14 11:13:15,314 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:13:15,317 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-14 11:13:15,317 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:13:15,317 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-14 11:13:15,323 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 11:13:15,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689333195323 (current time:1689333195323). 2023-07-14 11:13:15,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 11:13:15,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(139): Connect 0x70d3858b to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:13:15,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3a9520dc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:13:15,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:13:15,336 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49194, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:13:15,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70d3858b to 127.0.0.1:58300 2023-07-14 11:13:15,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:13:15,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(139): Connect 0x7f943663 to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:13:15,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13070bc7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:13:15,351 DEBUG [hconnection-0x74abb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:13:15,354 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49208, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:13:15,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:13:15,362 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39726, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:13:15,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f943663 to 127.0.0.1:58300 2023-07-14 11:13:15,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:13:15,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 11:13:15,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 11:13:15,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 11:13:15,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 11:13:15,369 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 11:13:15,370 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689333795369 2023-07-14 11:13:15,370 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-14 11:13:15,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 11:13:15,371 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 11:13:15,371 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 11:13:15,375 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 11:13:15,375 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 11:13:15,377 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 8 msec 2023-07-14 11:13:15,378 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 11:13:15,379 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689333795379 2023-07-14 11:13:15,471 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:13:15,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 11:13:15,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:13:15,473 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 11:13:15,673 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:13:15,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 11:13:15,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:13:15,674 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 11:13:15,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,800 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-14 11:13:15,800 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:13:15,800 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-14 11:13:15,800 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-14 11:13:15,801 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,801 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,802 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:15,802 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:15,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:15,802 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:15,802 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:15,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:15,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:15,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:15,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:15,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:15,803 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:15,803 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:15,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,803 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:15,803 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 11:13:15,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 11:13:15,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 11:13:15,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-14 11:13:15,805 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 11:13:15,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,805 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 11:13:15,805 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 11:13:15,809 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,810 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,810 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 11:13:15,810 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,810 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 11:13:15,810 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 11:13:15,810 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:13:15,810 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:13:15,811 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 11:13:15,813 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 11:13:15,813 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 11:13:15,810 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:13:15,813 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35929,1689333142490' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 11:13:15,817 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 11:13:15,817 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 11:13:15,818 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40207,1689333142617' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 11:13:15,813 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-14 11:13:15,818 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46581,1689333142353' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-14 11:13:15,820 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,820 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,820 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:15,821 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:15,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:15,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:13:15,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:13:15,822 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:13:15,822 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,822 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,822 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:13:15,822 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:13:15,822 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,822 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:13:15,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:13:15,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:15,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:15,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:15,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:13:15,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40207,1689333142617' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-14 11:13:15,824 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4393ec51[Count = 1] remaining members to acquire global barrier 2023-07-14 11:13:15,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:15,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:13:15,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:13:15,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:13:15,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:13:15,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:15,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:15,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:15,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:13:15,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35929,1689333142490' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-14 11:13:15,826 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4393ec51[Count = 0] remaining members to acquire global barrier 2023-07-14 11:13:15,826 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-14 11:13:15,826 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,828 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,828 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 11:13:15,828 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:15,829 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:15,829 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 11:13:15,829 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:13:15,830 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:13:15,830 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4. 2023-07-14 11:13:15,830 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4. started... 2023-07-14 11:13:15,831 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0ede94d10228021699025eb588f403a4: 2023-07-14 11:13:15,831 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,831 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,832 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:13:15,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,832 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 11:13:15,831 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,833 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 11:13:15,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,833 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 11:13:15,833 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 11:13:15,833 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,46581,1689333142353' in zk 2023-07-14 11:13:15,837 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:13:15,837 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:13:15,837 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74. 2023-07-14 11:13:15,837 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74. started... 2023-07-14 11:13:15,839 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bda374fe2ffd3ea9d290b1076dc33a74: 2023-07-14 11:13:15,839 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 11:13:15,839 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:13:15,839 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,839 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 11:13:15,839 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:13:15,839 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 11:13:15,923 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4. completed. 2023-07-14 11:13:15,923 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4. 2023-07-14 11:13:15,923 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:13:15,923 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:13:15,924 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:15,924 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 11:13:15,924 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,40207,1689333142617' in zk 2023-07-14 11:13:15,926 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:15,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:15,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:13:15,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:13:15,926 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 11:13:15,926 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:13:15,926 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 11:13:15,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:13:15,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:13:15,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:15,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:15,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:15,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:13:15,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:15,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:15,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,40207,1689333142617': 2023-07-14 11:13:15,931 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40207,1689333142617' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-14 11:13:15,945 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74. completed. 2023-07-14 11:13:15,945 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74. 2023-07-14 11:13:15,946 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:13:15,946 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:13:15,946 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:15,946 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-14 11:13:15,946 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,35929,1689333142490' in zk 2023-07-14 11:13:15,950 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:15,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:15,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:13:15,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:13:15,950 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 11:13:15,950 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:13:15,950 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-14 11:13:15,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:13:15,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:13:15,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:15,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:15,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:15,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:13:15,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:15,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:15,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:15,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,35929,1689333142490': 2023-07-14 11:13:15,958 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-14 11:13:15,958 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35929,1689333142490' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-14 11:13:15,958 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 11:13:15,959 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 11:13:15,959 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,959 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 11:13:15,962 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,962 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,962 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,962 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:15,962 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,962 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:15,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,962 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:15,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:13:15,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:13:15,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:15,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:15,963 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:15,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:15,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:15,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:15,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:15,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:13:15,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,964 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:15,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:13:15,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,966 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:15,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:15,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:15,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:15,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:13:15,974 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:13:15,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 11:13:15,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:13:15,977 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 11:13:15,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:15,982 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:15,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:15,983 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:15,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:15,984 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:15,988 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:15,988 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:15,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:15,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:15,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:15,988 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:15,989 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,989 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:15,989 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:15,989 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,989 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:15,989 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,989 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,988 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:15,989 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,988 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:15,988 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:15,989 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:15,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:15,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:15,989 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:15,990 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:15,990 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,990 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,989 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:13:15,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:15,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:15,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:15,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:15,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:15,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:15,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:15,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:16,042 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,077 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-14 11:13:16,077 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,078 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:16,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689333195370Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689333195989 (+619 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689333195989Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689333196008 (+19 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689333196024 (+16 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689333196077 (+53 ms) 2023-07-14 11:13:16,080 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 11:13:16,082 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 710 msec 2023-07-14 11:13:16,477 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:13:16,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 11:13:16,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 11:13:16,487 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 11:13:16,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35929] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 11:13:16,492 DEBUG [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-14 11:13:16,492 DEBUG [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4. 2023-07-14 11:13:16,492 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:13:16,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 11:13:16,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689333196512 (current time:1689333196512). 2023-07-14 11:13:16,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 11:13:16,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(139): Connect 0x085da479 to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:13:16,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3bbce983, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:13:16,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:13:16,534 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49214, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:13:16,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x085da479 to 127.0.0.1:58300 2023-07-14 11:13:16,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:13:16,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(139): Connect 0x473e9caa to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:13:16,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22a58658, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:13:16,645 DEBUG [hconnection-0x7e89937e-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:13:16,646 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49216, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:13:16,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:13:16,652 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39736, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:13:16,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x473e9caa to 127.0.0.1:58300 2023-07-14 11:13:16,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:13:16,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-14 11:13:16,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 11:13:16,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 11:13:16,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 11:13:16,658 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 11:13:16,659 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689333796659 2023-07-14 11:13:16,659 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-14 11:13:16,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-14 11:13:16,660 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 11:13:16,660 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 11:13:16,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 11:13:16,662 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-14 11:13:16,663 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-14 11:13:16,664 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 11:13:16,665 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689333796665 2023-07-14 11:13:16,678 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-14 11:13:16,678 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-14 11:13:16,678 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:13:16,679 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-14 11:13:16,679 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-14 11:13:16,680 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,680 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,681 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:16,681 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:16,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:16,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:16,681 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:16,681 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:16,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:16,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:16,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:16,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:16,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,682 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:16,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,682 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:16,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,683 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:16,683 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 11:13:16,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 11:13:16,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 11:13:16,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,684 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 11:13:16,684 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 11:13:16,684 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 11:13:16,684 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 11:13:16,684 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 11:13:16,684 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:13:16,684 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 11:13:16,685 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:13:16,685 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 11:13:16,686 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 11:13:16,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-14 11:13:16,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,686 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 11:13:16,687 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35929,1689333142490' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 11:13:16,686 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 11:13:16,687 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-14 11:13:16,687 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46581,1689333142353' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 11:13:16,687 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-14 11:13:16,687 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-14 11:13:16,687 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:13:16,688 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-14 11:13:16,688 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-14 11:13:16,688 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40207,1689333142617' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-14 11:13:16,690 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,690 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:16,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:16,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:13:16,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:13:16,691 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,691 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:13:16,691 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:13:16,692 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:16,692 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,692 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:13:16,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:13:16,692 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 11:13:16,693 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,693 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:13:16,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:16,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:16,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:16,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:13:16,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35929,1689333142490' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-14 11:13:16,695 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38c8354c[Count = 1] remaining members to acquire global barrier 2023-07-14 11:13:16,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:16,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:13:16,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:13:16,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:13:16,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:13:16,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 11:13:16,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:16,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:16,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:16,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:13:16,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40207,1689333142617' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-14 11:13:16,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38c8354c[Count = 0] remaining members to acquire global barrier 2023-07-14 11:13:16,697 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-14 11:13:16,697 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,700 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,700 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,700 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,700 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:16,700 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 11:13:16,700 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,700 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:13:16,700 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 11:13:16,700 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:16,700 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 11:13:16,700 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74. 2023-07-14 11:13:16,700 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:13:16,700 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74. started... 2023-07-14 11:13:16,700 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-14 11:13:16,701 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 11:13:16,701 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,46581,1689333142353' in zk 2023-07-14 11:13:16,701 INFO [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.HRegion(2745): Flushing bda374fe2ffd3ea9d290b1076dc33a74 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-14 11:13:16,703 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 11:13:16,703 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:13:16,703 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 11:13:16,710 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:13:16,710 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:13:16,710 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4. 2023-07-14 11:13:16,710 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4. started... 2023-07-14 11:13:16,710 INFO [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0ede94d10228021699025eb588f403a4 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-14 11:13:16,738 INFO [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testConsecutiveExports/bda374fe2ffd3ea9d290b1076dc33a74/.tmp/cf/affc929f55a24e61bd6c445f3fd2125e 2023-07-14 11:13:16,738 INFO [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testConsecutiveExports/0ede94d10228021699025eb588f403a4/.tmp/cf/60d4282f9a3b47fcacfd8acb840b9523 2023-07-14 11:13:16,747 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testConsecutiveExports/0ede94d10228021699025eb588f403a4/.tmp/cf/60d4282f9a3b47fcacfd8acb840b9523 as hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testConsecutiveExports/0ede94d10228021699025eb588f403a4/cf/60d4282f9a3b47fcacfd8acb840b9523 2023-07-14 11:13:16,747 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testConsecutiveExports/bda374fe2ffd3ea9d290b1076dc33a74/.tmp/cf/affc929f55a24e61bd6c445f3fd2125e as hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testConsecutiveExports/bda374fe2ffd3ea9d290b1076dc33a74/cf/affc929f55a24e61bd6c445f3fd2125e 2023-07-14 11:13:16,753 INFO [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testConsecutiveExports/bda374fe2ffd3ea9d290b1076dc33a74/cf/affc929f55a24e61bd6c445f3fd2125e, entries=48, sequenceid=6, filesize=8.1 K 2023-07-14 11:13:16,755 INFO [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for bda374fe2ffd3ea9d290b1076dc33a74 in 53ms, sequenceid=6, compaction requested=false 2023-07-14 11:13:16,755 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-14 11:13:16,755 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for bda374fe2ffd3ea9d290b1076dc33a74: 2023-07-14 11:13:16,756 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-14 11:13:16,756 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:13:16,756 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testConsecutiveExports/bda374fe2ffd3ea9d290b1076dc33a74/cf/affc929f55a24e61bd6c445f3fd2125e] hfiles 2023-07-14 11:13:16,756 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testConsecutiveExports/bda374fe2ffd3ea9d290b1076dc33a74/cf/affc929f55a24e61bd6c445f3fd2125e for snapshot=snaptb0-testConsecutiveExports 2023-07-14 11:13:16,760 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:13:16,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 11:13:16,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:13:16,762 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 11:13:16,768 INFO [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testConsecutiveExports/0ede94d10228021699025eb588f403a4/cf/60d4282f9a3b47fcacfd8acb840b9523, entries=2, sequenceid=6, filesize=5.0 K 2023-07-14 11:13:16,769 INFO [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 0ede94d10228021699025eb588f403a4 in 59ms, sequenceid=6, compaction requested=false 2023-07-14 11:13:16,775 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0ede94d10228021699025eb588f403a4: 2023-07-14 11:13:16,775 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-14 11:13:16,775 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:13:16,775 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testConsecutiveExports/0ede94d10228021699025eb588f403a4/cf/60d4282f9a3b47fcacfd8acb840b9523] hfiles 2023-07-14 11:13:16,775 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testConsecutiveExports/0ede94d10228021699025eb588f403a4/cf/60d4282f9a3b47fcacfd8acb840b9523 for snapshot=snaptb0-testConsecutiveExports 2023-07-14 11:13:16,810 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74. completed. 2023-07-14 11:13:16,810 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74. 2023-07-14 11:13:16,810 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:13:16,810 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:13:16,810 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:16,810 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 11:13:16,810 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,35929,1689333142490' in zk 2023-07-14 11:13:16,812 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:16,812 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 11:13:16,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:16,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:13:16,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:13:16,812 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:13:16,813 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 11:13:16,816 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4. completed. 2023-07-14 11:13:16,816 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4. 2023-07-14 11:13:16,816 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:13:16,816 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:13:16,816 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:16,816 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-14 11:13:16,816 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase9.apache.org,40207,1689333142617' in zk 2023-07-14 11:13:16,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:13:16,824 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:16,824 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-14 11:13:16,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:13:16,824 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:13:16,824 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-14 11:13:16,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 11:13:16,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:16,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:16,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:16,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:13:16,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 11:13:16,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:16,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:16,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:16,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,35929,1689333142490': 2023-07-14 11:13:16,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35929,1689333142490' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-14 11:13:16,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:16,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:13:16,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:13:16,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:13:16,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:13:16,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 11:13:16,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:16,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:16,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:16,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:13:16,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 11:13:16,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:16,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:16,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:16,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase9.apache.org,40207,1689333142617': 2023-07-14 11:13:16,834 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40207,1689333142617' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-14 11:13:16,834 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-14 11:13:16,834 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 11:13:16,834 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 11:13:16,834 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-14 11:13:16,834 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 11:13:16,837 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,837 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:13:16,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:13:16,837 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:16,837 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,837 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,837 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:16,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:13:16,838 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,838 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:16,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:16,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:16,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:16,838 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:16,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:16,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 11:13:16,838 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:16,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:16,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,839 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:16,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:13:16,839 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:16,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 11:13:16,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:16,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:16,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:16,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:13:16,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-14 11:13:16,843 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:16,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:16,843 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:16,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:16,844 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:16,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:16,853 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:16,853 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:16,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:16,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:16,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:16,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:16,854 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:16,854 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,854 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:16,854 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:16,855 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:16,855 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:16,857 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,857 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:16,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:16,857 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-14 11:13:16,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:16,857 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-14 11:13:16,857 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:13:16,857 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,859 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:16,859 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:16,859 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,859 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,857 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:16,860 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:16,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:16,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:16,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:16,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:16,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:16,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:16,863 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,894 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,919 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-14 11:13:16,920 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,920 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,920 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689333196659Consolidate snapshot: snaptb0-testConsecutiveExports at 1689333196857 (+198 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1689333196857Writing data manifest for snaptb0-testConsecutiveExports at 1689333196867 (+10 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689333196881 (+14 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689333196919 (+38 ms) 2023-07-14 11:13:16,923 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-14 11:13:16,930 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 264 msec 2023-07-14 11:13:16,962 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:13:16,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-14 11:13:16,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 11:13:16,964 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/local-export-1689333196964 2023-07-14 11:13:16,964 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/local-export-1689333196964, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/local-export-1689333196964, srcFsUri=hdfs://localhost:36847, srcDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4 2023-07-14 11:13:16,995 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36847, inputRoot=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4 2023-07-14 11:13:16,995 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@1d184a0, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/local-export-1689333196964, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/local-export-1689333196964/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 11:13:16,995 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36847, inputRoot=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4, snapshotDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-14 11:13:17,004 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/local-export-1689333196964/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 11:13:17,019 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:17,019 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:17,020 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:17,020 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:17,020 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:17,021 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:17,021 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:17,110 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/hadoop-2853015586431989703.jar 2023-07-14 11:13:17,111 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:17,111 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:17,111 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:17,112 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:17,112 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:17,112 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:17,113 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 11:13:17,113 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 11:13:17,113 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 11:13:17,114 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 11:13:17,114 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 11:13:17,115 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 11:13:17,115 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 11:13:17,115 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 11:13:17,116 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 11:13:17,116 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 11:13:17,116 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:13:17,117 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:13:17,117 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:13:17,117 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:13:17,118 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:13:17,118 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:13:17,119 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:13:18,192 WARN [Listener at jenkins-hbase9.apache.org/36907] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 11:13:18,195 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-14 11:13:18,197 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-14 11:13:19,230 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:13:19,230 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:13:19,234 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0002_000001 (auth:SIMPLE) 2023-07-14 11:13:19,923 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0003_000001 (auth:SIMPLE) 2023-07-14 11:13:20,030 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 11:13:25,659 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0003_000001 (auth:SIMPLE) 2023-07-14 11:13:27,957 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0003_000001 (auth:SIMPLE) 2023-07-14 11:13:31,558 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0003_000001 (auth:SIMPLE) 2023-07-14 11:13:33,527 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 11:13:33,527 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 11:13:33,534 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-14 11:13:33,534 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 11:13:33,535 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 11:13:33,535 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1095779325_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 11:13:33,538 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 11:13:33,538 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 11:13:33,538 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@38acfc86 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/local-export-1689333196964/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/local-export-1689333196964/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 11:13:33,539 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/local-export-1689333196964/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 11:13:33,539 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/local-export-1689333196964/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 11:13:33,541 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/local-export-1689333196964, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/local-export-1689333196964, srcFsUri=hdfs://localhost:36847, srcDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4 2023-07-14 11:13:33,571 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36847, inputRoot=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4 2023-07-14 11:13:33,571 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@3500ee54, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/local-export-1689333196964, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/local-export-1689333196964/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 11:13:33,571 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36847, inputRoot=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4, snapshotDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-14 11:13:33,584 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/local-export-1689333196964/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-14 11:13:33,602 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:33,603 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:33,603 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:33,603 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:33,604 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:33,604 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:33,604 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:33,687 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/hadoop-4249718233667757121.jar 2023-07-14 11:13:33,688 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:33,689 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:33,689 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:33,690 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:33,690 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:33,691 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 11:13:33,692 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 11:13:33,692 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 11:13:33,693 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 11:13:33,693 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 11:13:33,694 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 11:13:33,695 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 11:13:33,695 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 11:13:33,696 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 11:13:33,696 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 11:13:33,697 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 11:13:33,698 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:13:33,698 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:13:33,699 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:13:33,699 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:13:33,699 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:13:33,700 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:13:33,700 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:13:35,119 WARN [Listener at jenkins-hbase9.apache.org/36907] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 11:13:35,122 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-14 11:13:35,124 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-14 11:13:37,754 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:13:37,755 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:13:37,758 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0003_000001 (auth:SIMPLE) 2023-07-14 11:13:38,254 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0004_000001 (auth:SIMPLE) 2023-07-14 11:13:48,074 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0004_000001 (auth:SIMPLE) 2023-07-14 11:13:50,632 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0004_000001 (auth:SIMPLE) 2023-07-14 11:13:56,117 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0004_000001 (auth:SIMPLE) 2023-07-14 11:13:57,635 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 11:13:57,635 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 11:13:57,641 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-14 11:13:57,641 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 11:13:57,642 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 11:13:57,642 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1095779325_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 11:13:57,645 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 11:13:57,645 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 11:13:57,645 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@38acfc86 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/local-export-1689333196964/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/local-export-1689333196964/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-14 11:13:57,646 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/local-export-1689333196964/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-14 11:13:57,646 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/local-export-1689333196964/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-14 11:13:57,666 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-14 11:13:57,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testConsecutiveExports 2023-07-14 11:13:57,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-14 11:13:57,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 11:13:57,674 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333237673"}]},"ts":"1689333237673"} 2023-07-14 11:13:57,675 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-14 11:13:57,683 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-14 11:13:57,684 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0ede94d10228021699025eb588f403a4, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bda374fe2ffd3ea9d290b1076dc33a74, UNASSIGN}] 2023-07-14 11:13:57,686 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bda374fe2ffd3ea9d290b1076dc33a74, UNASSIGN 2023-07-14 11:13:57,688 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0ede94d10228021699025eb588f403a4, UNASSIGN 2023-07-14 11:13:57,689 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=bda374fe2ffd3ea9d290b1076dc33a74, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:57,689 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689333237689"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333237689"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333237689"}]},"ts":"1689333237689"} 2023-07-14 11:13:57,691 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=0ede94d10228021699025eb588f403a4, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:57,691 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689333237691"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333237691"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333237691"}]},"ts":"1689333237691"} 2023-07-14 11:13:57,692 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure bda374fe2ffd3ea9d290b1076dc33a74, server=jenkins-hbase9.apache.org,35929,1689333142490}] 2023-07-14 11:13:57,693 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 0ede94d10228021699025eb588f403a4, server=jenkins-hbase9.apache.org,40207,1689333142617}] 2023-07-14 11:13:57,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 11:13:57,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close bda374fe2ffd3ea9d290b1076dc33a74 2023-07-14 11:13:57,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing bda374fe2ffd3ea9d290b1076dc33a74, disabling compactions & flushes 2023-07-14 11:13:57,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74. 2023-07-14 11:13:57,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74. 2023-07-14 11:13:57,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74. after waiting 0 ms 2023-07-14 11:13:57,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74. 2023-07-14 11:13:57,847 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 0ede94d10228021699025eb588f403a4 2023-07-14 11:13:57,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 0ede94d10228021699025eb588f403a4, disabling compactions & flushes 2023-07-14 11:13:57,847 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4. 2023-07-14 11:13:57,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4. 2023-07-14 11:13:57,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4. after waiting 0 ms 2023-07-14 11:13:57,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4. 2023-07-14 11:13:57,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testConsecutiveExports/0ede94d10228021699025eb588f403a4/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 11:13:57,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:13:57,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testConsecutiveExports/bda374fe2ffd3ea9d290b1076dc33a74/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 11:13:57,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4. 2023-07-14 11:13:57,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 0ede94d10228021699025eb588f403a4: 2023-07-14 11:13:57,928 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:13:57,930 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74. 2023-07-14 11:13:57,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for bda374fe2ffd3ea9d290b1076dc33a74: 2023-07-14 11:13:57,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 0ede94d10228021699025eb588f403a4 2023-07-14 11:13:57,938 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=0ede94d10228021699025eb588f403a4, regionState=CLOSED 2023-07-14 11:13:57,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed bda374fe2ffd3ea9d290b1076dc33a74 2023-07-14 11:13:57,939 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689333237938"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333237938"}]},"ts":"1689333237938"} 2023-07-14 11:13:57,940 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=bda374fe2ffd3ea9d290b1076dc33a74, regionState=CLOSED 2023-07-14 11:13:57,940 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689333237940"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333237940"}]},"ts":"1689333237940"} 2023-07-14 11:13:57,946 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-14 11:13:57,946 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 0ede94d10228021699025eb588f403a4, server=jenkins-hbase9.apache.org,40207,1689333142617 in 249 msec 2023-07-14 11:13:57,947 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-14 11:13:57,947 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure bda374fe2ffd3ea9d290b1076dc33a74, server=jenkins-hbase9.apache.org,35929,1689333142490 in 251 msec 2023-07-14 11:13:57,948 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=0ede94d10228021699025eb588f403a4, UNASSIGN in 262 msec 2023-07-14 11:13:57,958 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-14 11:13:57,958 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=bda374fe2ffd3ea9d290b1076dc33a74, UNASSIGN in 263 msec 2023-07-14 11:13:57,959 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333237959"}]},"ts":"1689333237959"} 2023-07-14 11:13:57,962 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-14 11:13:57,964 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-14 11:13:57,967 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 298 msec 2023-07-14 11:13:57,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-14 11:13:57,978 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-14 11:13:57,979 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testConsecutiveExports 2023-07-14 11:13:57,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 11:13:57,987 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 11:13:57,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-14 11:13:57,991 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 11:13:57,994 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46581] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-14 11:13:57,996 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 11:13:57,996 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 11:13:57,996 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 11:13:57,996 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 11:13:57,997 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 11:13:57,997 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 11:13:57,998 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 11:13:57,998 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 11:13:57,999 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:13:57,999 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-14 11:13:57,999 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 11:13:57,999 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:13:57,999 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 11:13:57,999 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:13:58,000 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-14 11:13:58,000 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:13:58,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-14 11:13:58,010 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testConsecutiveExports/0ede94d10228021699025eb588f403a4 2023-07-14 11:13:58,011 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testConsecutiveExports/bda374fe2ffd3ea9d290b1076dc33a74 2023-07-14 11:13:58,016 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testConsecutiveExports/0ede94d10228021699025eb588f403a4/cf, FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testConsecutiveExports/0ede94d10228021699025eb588f403a4/recovered.edits] 2023-07-14 11:13:58,017 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testConsecutiveExports/bda374fe2ffd3ea9d290b1076dc33a74/cf, FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testConsecutiveExports/bda374fe2ffd3ea9d290b1076dc33a74/recovered.edits] 2023-07-14 11:13:58,027 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testConsecutiveExports/bda374fe2ffd3ea9d290b1076dc33a74/cf/affc929f55a24e61bd6c445f3fd2125e to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testConsecutiveExports/bda374fe2ffd3ea9d290b1076dc33a74/cf/affc929f55a24e61bd6c445f3fd2125e 2023-07-14 11:13:58,029 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testConsecutiveExports/0ede94d10228021699025eb588f403a4/cf/60d4282f9a3b47fcacfd8acb840b9523 to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testConsecutiveExports/0ede94d10228021699025eb588f403a4/cf/60d4282f9a3b47fcacfd8acb840b9523 2023-07-14 11:13:58,035 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testConsecutiveExports/0ede94d10228021699025eb588f403a4/recovered.edits/9.seqid to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testConsecutiveExports/0ede94d10228021699025eb588f403a4/recovered.edits/9.seqid 2023-07-14 11:13:58,036 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testConsecutiveExports/0ede94d10228021699025eb588f403a4 2023-07-14 11:13:58,042 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testConsecutiveExports/bda374fe2ffd3ea9d290b1076dc33a74/recovered.edits/9.seqid to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testConsecutiveExports/bda374fe2ffd3ea9d290b1076dc33a74/recovered.edits/9.seqid 2023-07-14 11:13:58,043 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testConsecutiveExports/bda374fe2ffd3ea9d290b1076dc33a74 2023-07-14 11:13:58,043 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-14 11:13:58,046 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 11:13:58,049 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-14 11:13:58,053 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-14 11:13:58,054 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 11:13:58,054 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-14 11:13:58,054 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689333238054"}]},"ts":"9223372036854775807"} 2023-07-14 11:13:58,054 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689333238054"}]},"ts":"9223372036854775807"} 2023-07-14 11:13:58,077 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 11:13:58,078 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0ede94d10228021699025eb588f403a4, NAME => 'testtb-testConsecutiveExports,,1689333194702.0ede94d10228021699025eb588f403a4.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => bda374fe2ffd3ea9d290b1076dc33a74, NAME => 'testtb-testConsecutiveExports,1,1689333194702.bda374fe2ffd3ea9d290b1076dc33a74.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 11:13:58,078 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-14 11:13:58,078 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689333238078"}]},"ts":"9223372036854775807"} 2023-07-14 11:13:58,084 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-14 11:13:58,094 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-14 11:13:58,097 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 115 msec 2023-07-14 11:13:58,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-14 11:13:58,103 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-14 11:13:58,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-14 11:13:58,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-14 11:13:58,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testConsecutiveExports" 2023-07-14 11:13:58,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-14 11:13:58,266 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=747 (was 766), OpenFileDescriptor=896 (was 937), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1193 (was 968) - SystemLoadAverage LEAK? -, ProcessCount=192 (was 190) - ProcessCount LEAK? -, AvailableMemoryMB=1358 (was 2434) 2023-07-14 11:13:58,266 WARN [Listener at jenkins-hbase9.apache.org/36907] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-14 11:13:58,298 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=1193, ProcessCount=192, AvailableMemoryMB=1356 2023-07-14 11:13:58,298 WARN [Listener at jenkins-hbase9.apache.org/36907] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-14 11:13:58,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 11:13:58,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:58,305 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 11:13:58,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-14 11:13:58,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 11:13:58,307 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 11:13:58,321 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c064228e507ec203ef0dbdaa998370bd 2023-07-14 11:13:58,322 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8c02737a08abfdba8d1f25cacbe44d6b 2023-07-14 11:13:58,322 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c064228e507ec203ef0dbdaa998370bd empty. 2023-07-14 11:13:58,323 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c064228e507ec203ef0dbdaa998370bd 2023-07-14 11:13:58,323 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8c02737a08abfdba8d1f25cacbe44d6b empty. 2023-07-14 11:13:58,324 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8c02737a08abfdba8d1f25cacbe44d6b 2023-07-14 11:13:58,324 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-14 11:13:58,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 11:13:58,451 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-14 11:13:58,452 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => c064228e507ec203ef0dbdaa998370bd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp 2023-07-14 11:13:58,453 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8c02737a08abfdba8d1f25cacbe44d6b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp 2023-07-14 11:13:58,531 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:13:58,531 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing c064228e507ec203ef0dbdaa998370bd, disabling compactions & flushes 2023-07-14 11:13:58,532 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd. 2023-07-14 11:13:58,532 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd. 2023-07-14 11:13:58,532 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd. after waiting 0 ms 2023-07-14 11:13:58,532 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd. 2023-07-14 11:13:58,532 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd. 2023-07-14 11:13:58,532 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for c064228e507ec203ef0dbdaa998370bd: 2023-07-14 11:13:58,581 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:13:58,581 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 8c02737a08abfdba8d1f25cacbe44d6b, disabling compactions & flushes 2023-07-14 11:13:58,582 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b. 2023-07-14 11:13:58,582 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b. 2023-07-14 11:13:58,582 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b. after waiting 0 ms 2023-07-14 11:13:58,582 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b. 2023-07-14 11:13:58,582 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b. 2023-07-14 11:13:58,582 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 8c02737a08abfdba8d1f25cacbe44d6b: 2023-07-14 11:13:58,585 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 11:13:58,586 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689333238586"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333238586"}]},"ts":"1689333238586"} 2023-07-14 11:13:58,587 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689333238586"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333238586"}]},"ts":"1689333238586"} 2023-07-14 11:13:58,609 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 11:13:58,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 11:13:58,612 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 11:13:58,613 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333238612"}]},"ts":"1689333238612"} 2023-07-14 11:13:58,614 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-14 11:13:58,619 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 11:13:58,621 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 11:13:58,622 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 11:13:58,622 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 11:13:58,622 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 11:13:58,626 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c064228e507ec203ef0dbdaa998370bd, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8c02737a08abfdba8d1f25cacbe44d6b, ASSIGN}] 2023-07-14 11:13:58,629 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8c02737a08abfdba8d1f25cacbe44d6b, ASSIGN 2023-07-14 11:13:58,629 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c064228e507ec203ef0dbdaa998370bd, ASSIGN 2023-07-14 11:13:58,630 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c064228e507ec203ef0dbdaa998370bd, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35929,1689333142490; forceNewPlan=false, retain=false 2023-07-14 11:13:58,630 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8c02737a08abfdba8d1f25cacbe44d6b, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40207,1689333142617; forceNewPlan=false, retain=false 2023-07-14 11:13:58,781 INFO [jenkins-hbase9:38311] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 11:13:58,784 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=8c02737a08abfdba8d1f25cacbe44d6b, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:58,784 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=c064228e507ec203ef0dbdaa998370bd, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:58,784 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689333238784"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333238784"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333238784"}]},"ts":"1689333238784"} 2023-07-14 11:13:58,784 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689333238784"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333238784"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333238784"}]},"ts":"1689333238784"} 2023-07-14 11:13:58,792 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure c064228e507ec203ef0dbdaa998370bd, server=jenkins-hbase9.apache.org,35929,1689333142490}] 2023-07-14 11:13:58,792 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 8c02737a08abfdba8d1f25cacbe44d6b, server=jenkins-hbase9.apache.org,40207,1689333142617}] 2023-07-14 11:13:58,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 11:13:58,956 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd. 2023-07-14 11:13:58,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c064228e507ec203ef0dbdaa998370bd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 11:13:58,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd. service=AccessControlService 2023-07-14 11:13:58,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:13:58,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion c064228e507ec203ef0dbdaa998370bd 2023-07-14 11:13:58,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:13:58,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for c064228e507ec203ef0dbdaa998370bd 2023-07-14 11:13:58,957 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for c064228e507ec203ef0dbdaa998370bd 2023-07-14 11:13:58,957 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b. 2023-07-14 11:13:58,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8c02737a08abfdba8d1f25cacbe44d6b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 11:13:58,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b. service=AccessControlService 2023-07-14 11:13:58,958 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:13:58,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 8c02737a08abfdba8d1f25cacbe44d6b 2023-07-14 11:13:58,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:13:58,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 8c02737a08abfdba8d1f25cacbe44d6b 2023-07-14 11:13:58,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 8c02737a08abfdba8d1f25cacbe44d6b 2023-07-14 11:13:58,962 INFO [StoreOpener-c064228e507ec203ef0dbdaa998370bd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c064228e507ec203ef0dbdaa998370bd 2023-07-14 11:13:58,962 INFO [StoreOpener-8c02737a08abfdba8d1f25cacbe44d6b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8c02737a08abfdba8d1f25cacbe44d6b 2023-07-14 11:13:58,965 DEBUG [StoreOpener-c064228e507ec203ef0dbdaa998370bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion/c064228e507ec203ef0dbdaa998370bd/cf 2023-07-14 11:13:58,965 DEBUG [StoreOpener-c064228e507ec203ef0dbdaa998370bd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion/c064228e507ec203ef0dbdaa998370bd/cf 2023-07-14 11:13:58,966 INFO [StoreOpener-c064228e507ec203ef0dbdaa998370bd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c064228e507ec203ef0dbdaa998370bd columnFamilyName cf 2023-07-14 11:13:58,967 INFO [StoreOpener-c064228e507ec203ef0dbdaa998370bd-1] regionserver.HStore(310): Store=c064228e507ec203ef0dbdaa998370bd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:13:58,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion/c064228e507ec203ef0dbdaa998370bd 2023-07-14 11:13:58,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion/c064228e507ec203ef0dbdaa998370bd 2023-07-14 11:13:58,973 DEBUG [StoreOpener-8c02737a08abfdba8d1f25cacbe44d6b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion/8c02737a08abfdba8d1f25cacbe44d6b/cf 2023-07-14 11:13:58,973 DEBUG [StoreOpener-8c02737a08abfdba8d1f25cacbe44d6b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion/8c02737a08abfdba8d1f25cacbe44d6b/cf 2023-07-14 11:13:58,974 INFO [StoreOpener-8c02737a08abfdba8d1f25cacbe44d6b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8c02737a08abfdba8d1f25cacbe44d6b columnFamilyName cf 2023-07-14 11:13:58,975 INFO [StoreOpener-8c02737a08abfdba8d1f25cacbe44d6b-1] regionserver.HStore(310): Store=8c02737a08abfdba8d1f25cacbe44d6b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:13:58,975 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for c064228e507ec203ef0dbdaa998370bd 2023-07-14 11:13:58,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion/8c02737a08abfdba8d1f25cacbe44d6b 2023-07-14 11:13:58,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion/8c02737a08abfdba8d1f25cacbe44d6b 2023-07-14 11:13:58,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion/c064228e507ec203ef0dbdaa998370bd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:13:58,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened c064228e507ec203ef0dbdaa998370bd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61606338, jitterRate=-0.08199402689933777}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:13:58,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for c064228e507ec203ef0dbdaa998370bd: 2023-07-14 11:13:58,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 8c02737a08abfdba8d1f25cacbe44d6b 2023-07-14 11:13:58,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd., pid=60, masterSystemTime=1689333238951 2023-07-14 11:13:58,988 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=c064228e507ec203ef0dbdaa998370bd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:58,989 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689333238988"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333238988"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333238988"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333238988"}]},"ts":"1689333238988"} 2023-07-14 11:13:58,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd. 2023-07-14 11:13:58,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd. 2023-07-14 11:13:59,001 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-14 11:13:59,001 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure c064228e507ec203ef0dbdaa998370bd, server=jenkins-hbase9.apache.org,35929,1689333142490 in 200 msec 2023-07-14 11:13:59,004 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c064228e507ec203ef0dbdaa998370bd, ASSIGN in 375 msec 2023-07-14 11:13:59,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion/8c02737a08abfdba8d1f25cacbe44d6b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:13:59,011 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 8c02737a08abfdba8d1f25cacbe44d6b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75032582, jitterRate=0.11807259917259216}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:13:59,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 8c02737a08abfdba8d1f25cacbe44d6b: 2023-07-14 11:13:59,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b., pid=61, masterSystemTime=1689333238952 2023-07-14 11:13:59,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b. 2023-07-14 11:13:59,017 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b. 2023-07-14 11:13:59,017 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=8c02737a08abfdba8d1f25cacbe44d6b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:59,017 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689333239017"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333239017"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333239017"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333239017"}]},"ts":"1689333239017"} 2023-07-14 11:13:59,021 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-14 11:13:59,021 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 8c02737a08abfdba8d1f25cacbe44d6b, server=jenkins-hbase9.apache.org,40207,1689333142617 in 227 msec 2023-07-14 11:13:59,024 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-14 11:13:59,024 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8c02737a08abfdba8d1f25cacbe44d6b, ASSIGN in 395 msec 2023-07-14 11:13:59,024 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 11:13:59,025 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333239024"}]},"ts":"1689333239024"} 2023-07-14 11:13:59,026 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-14 11:13:59,029 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 11:13:59,029 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-14 11:13:59,032 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46581] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 11:13:59,034 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:13:59,034 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:13:59,034 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:13:59,034 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:13:59,036 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 11:13:59,036 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 11:13:59,036 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 11:13:59,036 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 11:13:59,040 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 735 msec 2023-07-14 11:13:59,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-14 11:13:59,413 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-14 11:13:59,413 DEBUG [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-14 11:13:59,413 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:13:59,423 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-14 11:13:59,423 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:13:59,423 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-14 11:13:59,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 11:13:59,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689333239429 (current time:1689333239429). 2023-07-14 11:13:59,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 11:13:59,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(139): Connect 0x034d2a03 to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:13:59,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@748b85bd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:13:59,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:13:59,455 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:13:59,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x034d2a03 to 127.0.0.1:58300 2023-07-14 11:13:59,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:13:59,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(139): Connect 0x10053067 to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:13:59,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7af20d56, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:13:59,500 DEBUG [hconnection-0x52fcc9d8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:13:59,504 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45256, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:13:59,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:13:59,513 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37214, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:13:59,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10053067 to 127.0.0.1:58300 2023-07-14 11:13:59,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:13:59,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 11:13:59,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 11:13:59,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 11:13:59,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 11:13:59,522 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 11:13:59,524 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689333839524 2023-07-14 11:13:59,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 11:13:59,525 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,526 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 11:13:59,527 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 11:13:59,530 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 11:13:59,533 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 11:13:59,537 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 10 msec 2023-07-14 11:13:59,539 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 11:13:59,541 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689333839541 2023-07-14 11:13:59,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,603 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-14 11:13:59,603 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:13:59,610 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-14 11:13:59,610 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-14 11:13:59,610 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,610 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,612 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:59,612 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:59,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:59,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:59,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:59,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:59,612 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:59,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:59,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:59,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,613 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,613 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 11:13:59,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,614 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 11:13:59,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 11:13:59,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,615 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 11:13:59,615 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:59,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,616 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:59,616 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:59,617 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:59,617 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 11:13:59,621 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-14 11:13:59,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,622 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 11:13:59,625 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,625 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 11:13:59,625 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:13:59,625 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,625 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,626 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 11:13:59,644 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 11:13:59,644 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 11:13:59,644 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46581,1689333142353' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 11:13:59,644 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:13:59,644 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:13:59,648 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 11:13:59,648 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:13:59,648 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 11:13:59,648 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 11:13:59,648 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40207,1689333142617' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 11:13:59,650 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 11:13:59,650 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 11:13:59,650 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35929,1689333142490' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 11:13:59,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 11:13:59,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:13:59,651 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,651 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 11:13:59,651 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,651 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:13:59,652 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,652 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:59,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:59,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:13:59,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:13:59,654 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:59,654 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,654 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,654 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:13:59,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:13:59,655 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,655 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:13:59,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:13:59,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:59,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:59,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:59,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:13:59,658 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35929,1689333142490' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 11:13:59,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f9d7e39[Count = 1] remaining members to acquire global barrier 2023-07-14 11:13:59,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:59,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:13:59,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:13:59,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:13:59,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:13:59,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:59,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:59,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:59,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:13:59,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40207,1689333142617' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 11:13:59,667 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f9d7e39[Count = 0] remaining members to acquire global barrier 2023-07-14 11:13:59,667 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-14 11:13:59,667 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,668 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,668 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,668 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 11:13:59,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,668 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 11:13:59,668 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:59,669 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:13:59,669 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:13:59,669 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,669 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd. 2023-07-14 11:13:59,669 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:59,669 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd. started... 2023-07-14 11:13:59,669 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 11:13:59,669 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 11:13:59,669 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,46581,1689333142353' in zk 2023-07-14 11:13:59,669 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 11:13:59,669 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:13:59,669 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:13:59,670 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b. 2023-07-14 11:13:59,670 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b. started... 2023-07-14 11:13:59,675 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 11:13:59,675 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:13:59,675 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 11:13:59,680 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c064228e507ec203ef0dbdaa998370bd: 2023-07-14 11:13:59,680 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8c02737a08abfdba8d1f25cacbe44d6b: 2023-07-14 11:13:59,681 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,681 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,681 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:13:59,681 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:13:59,681 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 11:13:59,681 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 11:13:59,805 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b. completed. 2023-07-14 11:13:59,805 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b. 2023-07-14 11:13:59,805 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:13:59,805 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:13:59,805 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:59,805 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 11:13:59,805 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,40207,1689333142617' in zk 2023-07-14 11:13:59,811 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 11:13:59,811 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:59,811 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:13:59,811 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 11:13:59,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:59,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:13:59,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:13:59,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:13:59,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:13:59,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:59,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:59,814 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd. completed. 2023-07-14 11:13:59,815 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd. 2023-07-14 11:13:59,817 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:13:59,817 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:13:59,817 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:59,817 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 11:13:59,817 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,35929,1689333142490' in zk 2023-07-14 11:13:59,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:59,823 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 11:13:59,823 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:13:59,823 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 11:13:59,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:13:59,825 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:59,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:59,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:59,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:59,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,40207,1689333142617': 2023-07-14 11:13:59,829 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40207,1689333142617' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-14 11:13:59,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:59,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:13:59,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:13:59,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:13:59,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:13:59,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:59,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:59,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:59,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:13:59,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:59,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:59,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:59,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,35929,1689333142490': 2023-07-14 11:13:59,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35929,1689333142490' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-14 11:13:59,850 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-14 11:13:59,850 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 11:13:59,850 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 11:13:59,850 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,850 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 11:13:59,851 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:13:59,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 11:13:59,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:13:59,853 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 11:13:59,855 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,855 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,855 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:59,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,855 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:59,856 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,855 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,856 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:59,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:59,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:59,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:59,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:59,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:59,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:13:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:13:59,857 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:59,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:13:59,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,866 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:59,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,867 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:59,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:13:59,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:59,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:59,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:59,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:13:59,869 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:59,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,869 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:59,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:59,870 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:59,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:59,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:59,874 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:59,874 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:59,874 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:59,874 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,874 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:59,874 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:59,874 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:59,874 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,874 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,874 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:13:59,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:59,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:59,875 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:59,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:59,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:59,874 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:13:59,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:59,874 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:13:59,874 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,878 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:13:59,878 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,878 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:13:59,878 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:13:59,878 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,878 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:59,878 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:13:59,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:13:59,879 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:13:59,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:59,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:59,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:13:59,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:13:59,938 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,020 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-14 11:14:00,020 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,021 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,021 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689333239525Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689333239874 (+349 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689333239875 (+1 ms)Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689333239891 (+16 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689333239926 (+35 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689333240020 (+94 ms) 2023-07-14 11:14:00,024 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 11:14:00,026 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 498 msec 2023-07-14 11:14:00,153 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:00,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 11:14:00,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 11:14:00,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 11:14:00,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35929] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 11:14:00,204 DEBUG [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,204 DEBUG [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd. 2023-07-14 11:14:00,206 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:14:00,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 11:14:00,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689333240236 (current time:1689333240236). 2023-07-14 11:14:00,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 11:14:00,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(139): Connect 0x1c89b7ea to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:14:00,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7209279f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:14:00,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:00,283 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:00,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c89b7ea to 127.0.0.1:58300 2023-07-14 11:14:00,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:14:00,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(139): Connect 0x09eda058 to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:14:00,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@588a7068, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:14:00,300 DEBUG [hconnection-0x63849139-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:00,303 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:45276, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:00,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:00,311 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:37218, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:00,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09eda058 to 127.0.0.1:58300 2023-07-14 11:14:00,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:14:00,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-14 11:14:00,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 11:14:00,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 11:14:00,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 11:14:00,317 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 11:14:00,317 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689333840317 2023-07-14 11:14:00,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-14 11:14:00,317 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,319 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 11:14:00,319 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 11:14:00,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 11:14:00,321 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-14 11:14:00,323 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-14 11:14:00,324 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 11:14:00,325 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689333840325 2023-07-14 11:14:00,341 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,341 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-14 11:14:00,341 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:00,343 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-14 11:14:00,343 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-14 11:14:00,344 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,344 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,345 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:00,345 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:00,345 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:00,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:00,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:00,345 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:00,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:00,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:00,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:00,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:00,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,346 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:00,346 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:00,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,346 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,347 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:00,347 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 11:14:00,347 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,347 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 11:14:00,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 11:14:00,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,347 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 11:14:00,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-14 11:14:00,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,348 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,348 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 11:14:00,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,348 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-14 11:14:00,348 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,348 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 11:14:00,348 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 11:14:00,348 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:00,348 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:00,357 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,359 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 11:14:00,359 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-14 11:14:00,359 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:00,359 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 11:14:00,361 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-14 11:14:00,361 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 11:14:00,361 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46581,1689333142353' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 11:14:00,361 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 11:14:00,361 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35929,1689333142490' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 11:14:00,359 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-14 11:14:00,361 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40207,1689333142617' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-14 11:14:00,363 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,363 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,363 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:00,364 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,364 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,364 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:00,364 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:00,364 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:00,365 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:00,365 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,365 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:00,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:00,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:00,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:00,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:00,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:00,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40207,1689333142617' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 11:14:00,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58ebc173[Count = 1] remaining members to acquire global barrier 2023-07-14 11:14:00,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:00,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:00,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:00,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:00,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:00,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:00,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:00,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:00,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:00,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35929,1689333142490' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-14 11:14:00,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58ebc173[Count = 0] remaining members to acquire global barrier 2023-07-14 11:14:00,370 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-14 11:14:00,370 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,373 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,373 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,373 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 11:14:00,373 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 11:14:00,373 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 11:14:00,373 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,373 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:14:00,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,373 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,46581,1689333142353' in zk 2023-07-14 11:14:00,373 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b. 2023-07-14 11:14:00,373 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-14 11:14:00,373 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:00,373 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:14:00,373 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b. started... 2023-07-14 11:14:00,374 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:00,374 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 11:14:00,374 INFO [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8c02737a08abfdba8d1f25cacbe44d6b 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-14 11:14:00,375 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:14:00,375 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:14:00,375 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd. 2023-07-14 11:14:00,375 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 11:14:00,375 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:00,375 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 11:14:00,375 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd. started... 2023-07-14 11:14:00,377 INFO [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c064228e507ec203ef0dbdaa998370bd 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-14 11:14:00,419 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:00,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 11:14:00,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:00,422 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 11:14:00,436 INFO [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion/c064228e507ec203ef0dbdaa998370bd/.tmp/cf/48508517046441fb80422684bcd33912 2023-07-14 11:14:00,446 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion/c064228e507ec203ef0dbdaa998370bd/.tmp/cf/48508517046441fb80422684bcd33912 as hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion/c064228e507ec203ef0dbdaa998370bd/cf/48508517046441fb80422684bcd33912 2023-07-14 11:14:00,454 INFO [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion/c064228e507ec203ef0dbdaa998370bd/cf/48508517046441fb80422684bcd33912, entries=4, sequenceid=6, filesize=5.1 K 2023-07-14 11:14:00,456 INFO [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for c064228e507ec203ef0dbdaa998370bd in 79ms, sequenceid=6, compaction requested=false 2023-07-14 11:14:00,456 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-14 11:14:00,456 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c064228e507ec203ef0dbdaa998370bd: 2023-07-14 11:14:00,457 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,457 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:14:00,457 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion/c064228e507ec203ef0dbdaa998370bd/cf/48508517046441fb80422684bcd33912] hfiles 2023-07-14 11:14:00,457 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion/c064228e507ec203ef0dbdaa998370bd/cf/48508517046441fb80422684bcd33912 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,472 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd. completed. 2023-07-14 11:14:00,472 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd. 2023-07-14 11:14:00,472 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:14:00,472 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:14:00,472 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:00,472 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 11:14:00,472 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,35929,1689333142490' in zk 2023-07-14 11:14:00,474 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:00,474 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 11:14:00,474 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:00,475 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 11:14:00,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:00,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:00,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:00,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:00,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:00,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:00,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:00,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:00,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:00,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:00,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:00,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,35929,1689333142490': 2023-07-14 11:14:00,482 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35929,1689333142490' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-14 11:14:00,622 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:00,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 11:14:00,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:00,624 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 11:14:00,839 INFO [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion/8c02737a08abfdba8d1f25cacbe44d6b/.tmp/cf/e99e6e6c4a214eb88bb40d9187e2abc6 2023-07-14 11:14:00,849 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion/8c02737a08abfdba8d1f25cacbe44d6b/.tmp/cf/e99e6e6c4a214eb88bb40d9187e2abc6 as hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion/8c02737a08abfdba8d1f25cacbe44d6b/cf/e99e6e6c4a214eb88bb40d9187e2abc6 2023-07-14 11:14:00,856 INFO [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion/8c02737a08abfdba8d1f25cacbe44d6b/cf/e99e6e6c4a214eb88bb40d9187e2abc6, entries=46, sequenceid=6, filesize=7.9 K 2023-07-14 11:14:00,858 INFO [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 8c02737a08abfdba8d1f25cacbe44d6b in 484ms, sequenceid=6, compaction requested=false 2023-07-14 11:14:00,860 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8c02737a08abfdba8d1f25cacbe44d6b: 2023-07-14 11:14:00,860 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,860 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:14:00,860 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion/8c02737a08abfdba8d1f25cacbe44d6b/cf/e99e6e6c4a214eb88bb40d9187e2abc6] hfiles 2023-07-14 11:14:00,860 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion/8c02737a08abfdba8d1f25cacbe44d6b/cf/e99e6e6c4a214eb88bb40d9187e2abc6 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:00,924 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:00,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 11:14:00,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:00,925 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 11:14:01,323 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b. completed. 2023-07-14 11:14:01,324 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b. 2023-07-14 11:14:01,324 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:14:01,324 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:14:01,324 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:01,324 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-14 11:14:01,324 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase9.apache.org,40207,1689333142617' in zk 2023-07-14 11:14:01,326 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-14 11:14:01,326 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:01,326 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:01,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:01,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:01,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:01,326 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-14 11:14:01,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:01,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:01,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:01,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:01,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:01,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:01,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:01,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:01,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:01,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase9.apache.org,40207,1689333142617': 2023-07-14 11:14:01,336 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40207,1689333142617' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-14 11:14:01,336 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-14 11:14:01,336 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 11:14:01,336 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 11:14:01,336 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,336 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 11:14:01,342 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,342 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:01,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:01,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:01,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,345 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,345 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:01,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,345 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:01,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:01,346 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,346 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:01,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:01,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:01,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:01,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:01,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:01,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,350 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:01,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:01,350 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:01,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,352 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:01,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:01,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:01,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:01,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:01,355 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:01,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,356 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:01,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:01,357 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:01,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:01,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:01,361 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:01,362 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,362 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:01,362 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:01,362 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:01,362 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:01,362 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:01,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:01,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:01,362 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:01,362 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:01,362 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:01,362 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,362 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:01,362 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,370 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:01,370 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,370 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:01,370 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:01,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:01,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:01,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:01,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:01,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:01,362 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:01,370 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,370 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,370 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:01,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:01,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:01,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:01,425 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:01,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 11:14:01,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:01,427 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-14 11:14:01,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,602 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-14 11:14:01,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,603 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:01,603 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689333240318Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689333241362 (+1044 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689333241362Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689333241391 (+29 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689333241452 (+61 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689333241602 (+150 ms) 2023-07-14 11:14:01,606 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-14 11:14:01,608 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 1.2880 sec 2023-07-14 11:14:02,307 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0004_000001 (auth:SIMPLE) 2023-07-14 11:14:02,427 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:02,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-14 11:14:02,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 11:14:02,470 DEBUG [Listener at jenkins-hbase9.apache.org/36907] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 11:14:02,478 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:57934, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 11:14:02,480 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35929] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 11:14:02,481 DEBUG [Listener at jenkins-hbase9.apache.org/36907] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 11:14:02,489 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39290, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 11:14:02,489 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 11:14:02,490 DEBUG [Listener at jenkins-hbase9.apache.org/36907] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-14 11:14:02,498 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-14 11:14:02,498 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46581] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-14 11:14:02,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 11:14:02,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:02,514 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 11:14:02,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-14 11:14:02,515 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 11:14:02,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 11:14:02,520 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79279148d2b091d8cb3e58b9342bcf92 2023-07-14 11:14:02,520 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b65c514e176081c1fc6bf676dd78574f 2023-07-14 11:14:02,521 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79279148d2b091d8cb3e58b9342bcf92 empty. 2023-07-14 11:14:02,521 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79279148d2b091d8cb3e58b9342bcf92 2023-07-14 11:14:02,529 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b65c514e176081c1fc6bf676dd78574f empty. 2023-07-14 11:14:02,529 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b65c514e176081c1fc6bf676dd78574f 2023-07-14 11:14:02,529 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-14 11:14:02,588 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-14 11:14:02,600 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 79279148d2b091d8cb3e58b9342bcf92, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242501.79279148d2b091d8cb3e58b9342bcf92.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp 2023-07-14 11:14:02,614 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => b65c514e176081c1fc6bf676dd78574f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333242501.b65c514e176081c1fc6bf676dd78574f.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp 2023-07-14 11:14:02,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 11:14:02,714 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242501.79279148d2b091d8cb3e58b9342bcf92.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:02,714 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 79279148d2b091d8cb3e58b9342bcf92, disabling compactions & flushes 2023-07-14 11:14:02,714 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242501.79279148d2b091d8cb3e58b9342bcf92. 2023-07-14 11:14:02,714 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242501.79279148d2b091d8cb3e58b9342bcf92. 2023-07-14 11:14:02,714 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242501.79279148d2b091d8cb3e58b9342bcf92. after waiting 0 ms 2023-07-14 11:14:02,714 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242501.79279148d2b091d8cb3e58b9342bcf92. 2023-07-14 11:14:02,714 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242501.79279148d2b091d8cb3e58b9342bcf92. 2023-07-14 11:14:02,714 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 79279148d2b091d8cb3e58b9342bcf92: 2023-07-14 11:14:02,717 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333242501.b65c514e176081c1fc6bf676dd78574f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:02,717 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing b65c514e176081c1fc6bf676dd78574f, disabling compactions & flushes 2023-07-14 11:14:02,717 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333242501.b65c514e176081c1fc6bf676dd78574f. 2023-07-14 11:14:02,717 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333242501.b65c514e176081c1fc6bf676dd78574f. 2023-07-14 11:14:02,717 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333242501.b65c514e176081c1fc6bf676dd78574f. after waiting 0 ms 2023-07-14 11:14:02,717 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333242501.b65c514e176081c1fc6bf676dd78574f. 2023-07-14 11:14:02,717 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333242501.b65c514e176081c1fc6bf676dd78574f. 2023-07-14 11:14:02,717 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for b65c514e176081c1fc6bf676dd78574f: 2023-07-14 11:14:02,721 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 11:14:02,723 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242501.79279148d2b091d8cb3e58b9342bcf92.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689333242722"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333242722"}]},"ts":"1689333242722"} 2023-07-14 11:14:02,723 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333242501.b65c514e176081c1fc6bf676dd78574f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689333242722"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333242722"}]},"ts":"1689333242722"} 2023-07-14 11:14:02,725 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 11:14:02,727 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 11:14:02,727 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333242727"}]},"ts":"1689333242727"} 2023-07-14 11:14:02,731 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-14 11:14:02,734 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 11:14:02,736 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 11:14:02,736 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 11:14:02,736 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 11:14:02,736 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 11:14:02,737 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=79279148d2b091d8cb3e58b9342bcf92, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b65c514e176081c1fc6bf676dd78574f, ASSIGN}] 2023-07-14 11:14:02,740 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b65c514e176081c1fc6bf676dd78574f, ASSIGN 2023-07-14 11:14:02,740 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=79279148d2b091d8cb3e58b9342bcf92, ASSIGN 2023-07-14 11:14:02,741 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b65c514e176081c1fc6bf676dd78574f, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35929,1689333142490; forceNewPlan=false, retain=false 2023-07-14 11:14:02,741 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=79279148d2b091d8cb3e58b9342bcf92, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46581,1689333142353; forceNewPlan=false, retain=false 2023-07-14 11:14:02,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 11:14:02,891 INFO [jenkins-hbase9:38311] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 11:14:02,894 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=b65c514e176081c1fc6bf676dd78574f, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:02,895 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=79279148d2b091d8cb3e58b9342bcf92, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:02,895 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333242501.b65c514e176081c1fc6bf676dd78574f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689333242894"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333242894"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333242894"}]},"ts":"1689333242894"} 2023-07-14 11:14:02,895 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242501.79279148d2b091d8cb3e58b9342bcf92.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689333242894"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333242894"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333242894"}]},"ts":"1689333242894"} 2023-07-14 11:14:02,900 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure b65c514e176081c1fc6bf676dd78574f, server=jenkins-hbase9.apache.org,35929,1689333142490}] 2023-07-14 11:14:02,903 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 79279148d2b091d8cb3e58b9342bcf92, server=jenkins-hbase9.apache.org,46581,1689333142353}] 2023-07-14 11:14:03,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242501.79279148d2b091d8cb3e58b9342bcf92. 2023-07-14 11:14:03,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 79279148d2b091d8cb3e58b9342bcf92, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242501.79279148d2b091d8cb3e58b9342bcf92.', STARTKEY => '', ENDKEY => '2'} 2023-07-14 11:14:03,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242501.79279148d2b091d8cb3e58b9342bcf92. service=AccessControlService 2023-07-14 11:14:03,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:14:03,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 79279148d2b091d8cb3e58b9342bcf92 2023-07-14 11:14:03,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242501.79279148d2b091d8cb3e58b9342bcf92.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:03,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 79279148d2b091d8cb3e58b9342bcf92 2023-07-14 11:14:03,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 79279148d2b091d8cb3e58b9342bcf92 2023-07-14 11:14:03,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333242501.b65c514e176081c1fc6bf676dd78574f. 2023-07-14 11:14:03,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b65c514e176081c1fc6bf676dd78574f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333242501.b65c514e176081c1fc6bf676dd78574f.', STARTKEY => '2', ENDKEY => ''} 2023-07-14 11:14:03,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333242501.b65c514e176081c1fc6bf676dd78574f. service=AccessControlService 2023-07-14 11:14:03,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:14:03,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 b65c514e176081c1fc6bf676dd78574f 2023-07-14 11:14:03,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333242501.b65c514e176081c1fc6bf676dd78574f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:03,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for b65c514e176081c1fc6bf676dd78574f 2023-07-14 11:14:03,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for b65c514e176081c1fc6bf676dd78574f 2023-07-14 11:14:03,078 INFO [StoreOpener-79279148d2b091d8cb3e58b9342bcf92-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 79279148d2b091d8cb3e58b9342bcf92 2023-07-14 11:14:03,078 INFO [StoreOpener-b65c514e176081c1fc6bf676dd78574f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b65c514e176081c1fc6bf676dd78574f 2023-07-14 11:14:03,080 DEBUG [StoreOpener-79279148d2b091d8cb3e58b9342bcf92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79279148d2b091d8cb3e58b9342bcf92/cf 2023-07-14 11:14:03,080 DEBUG [StoreOpener-79279148d2b091d8cb3e58b9342bcf92-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79279148d2b091d8cb3e58b9342bcf92/cf 2023-07-14 11:14:03,080 INFO [StoreOpener-79279148d2b091d8cb3e58b9342bcf92-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 79279148d2b091d8cb3e58b9342bcf92 columnFamilyName cf 2023-07-14 11:14:03,081 INFO [StoreOpener-79279148d2b091d8cb3e58b9342bcf92-1] regionserver.HStore(310): Store=79279148d2b091d8cb3e58b9342bcf92/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:14:03,081 DEBUG [StoreOpener-b65c514e176081c1fc6bf676dd78574f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b65c514e176081c1fc6bf676dd78574f/cf 2023-07-14 11:14:03,081 DEBUG [StoreOpener-b65c514e176081c1fc6bf676dd78574f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b65c514e176081c1fc6bf676dd78574f/cf 2023-07-14 11:14:03,082 INFO [StoreOpener-b65c514e176081c1fc6bf676dd78574f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b65c514e176081c1fc6bf676dd78574f columnFamilyName cf 2023-07-14 11:14:03,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79279148d2b091d8cb3e58b9342bcf92 2023-07-14 11:14:03,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79279148d2b091d8cb3e58b9342bcf92 2023-07-14 11:14:03,083 INFO [StoreOpener-b65c514e176081c1fc6bf676dd78574f-1] regionserver.HStore(310): Store=b65c514e176081c1fc6bf676dd78574f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:14:03,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b65c514e176081c1fc6bf676dd78574f 2023-07-14 11:14:03,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b65c514e176081c1fc6bf676dd78574f 2023-07-14 11:14:03,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for b65c514e176081c1fc6bf676dd78574f 2023-07-14 11:14:03,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 79279148d2b091d8cb3e58b9342bcf92 2023-07-14 11:14:03,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b65c514e176081c1fc6bf676dd78574f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:14:03,102 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened b65c514e176081c1fc6bf676dd78574f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72935308, jitterRate=0.08682078123092651}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:14:03,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for b65c514e176081c1fc6bf676dd78574f: 2023-07-14 11:14:03,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79279148d2b091d8cb3e58b9342bcf92/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:14:03,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 79279148d2b091d8cb3e58b9342bcf92; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71984282, jitterRate=0.07264938950538635}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:14:03,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 79279148d2b091d8cb3e58b9342bcf92: 2023-07-14 11:14:03,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333242501.b65c514e176081c1fc6bf676dd78574f., pid=69, masterSystemTime=1689333243058 2023-07-14 11:14:03,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242501.79279148d2b091d8cb3e58b9342bcf92., pid=70, masterSystemTime=1689333243058 2023-07-14 11:14:03,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333242501.b65c514e176081c1fc6bf676dd78574f. 2023-07-14 11:14:03,107 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333242501.b65c514e176081c1fc6bf676dd78574f. 2023-07-14 11:14:03,108 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=b65c514e176081c1fc6bf676dd78574f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:03,108 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333242501.b65c514e176081c1fc6bf676dd78574f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689333243107"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333243107"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333243107"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333243107"}]},"ts":"1689333243107"} 2023-07-14 11:14:03,109 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=79279148d2b091d8cb3e58b9342bcf92, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:03,109 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242501.79279148d2b091d8cb3e58b9342bcf92.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689333243109"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333243109"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333243109"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333243109"}]},"ts":"1689333243109"} 2023-07-14 11:14:03,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242501.79279148d2b091d8cb3e58b9342bcf92. 2023-07-14 11:14:03,109 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242501.79279148d2b091d8cb3e58b9342bcf92. 2023-07-14 11:14:03,117 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-14 11:14:03,117 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure b65c514e176081c1fc6bf676dd78574f, server=jenkins-hbase9.apache.org,35929,1689333142490 in 211 msec 2023-07-14 11:14:03,118 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-14 11:14:03,118 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 79279148d2b091d8cb3e58b9342bcf92, server=jenkins-hbase9.apache.org,46581,1689333142353 in 209 msec 2023-07-14 11:14:03,120 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b65c514e176081c1fc6bf676dd78574f, ASSIGN in 381 msec 2023-07-14 11:14:03,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 11:14:03,122 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-14 11:14:03,122 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=79279148d2b091d8cb3e58b9342bcf92, ASSIGN in 382 msec 2023-07-14 11:14:03,123 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 11:14:03,123 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333243123"}]},"ts":"1689333243123"} 2023-07-14 11:14:03,124 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-14 11:14:03,127 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 11:14:03,127 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-14 11:14:03,129 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46581] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-14 11:14:03,131 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:03,131 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:03,131 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:03,131 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:03,133 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:03,134 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:03,134 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:03,134 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:03,133 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:03,134 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:03,134 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:03,134 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:03,135 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 632 msec 2023-07-14 11:14:03,546 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 11:14:03,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-14 11:14:03,623 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-14 11:14:03,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.HMaster$2(1952): Client=jenkins//172.31.2.10 merge regions 79279148d2b091d8cb3e58b9342bcf92, b65c514e176081c1fc6bf676dd78574f 2023-07-14 11:14:03,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[79279148d2b091d8cb3e58b9342bcf92, b65c514e176081c1fc6bf676dd78574f], force=true 2023-07-14 11:14:03,739 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[79279148d2b091d8cb3e58b9342bcf92, b65c514e176081c1fc6bf676dd78574f], force=true 2023-07-14 11:14:03,740 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[79279148d2b091d8cb3e58b9342bcf92, b65c514e176081c1fc6bf676dd78574f], force=true 2023-07-14 11:14:03,740 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[79279148d2b091d8cb3e58b9342bcf92, b65c514e176081c1fc6bf676dd78574f], force=true 2023-07-14 11:14:03,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 11:14:03,777 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=79279148d2b091d8cb3e58b9342bcf92, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b65c514e176081c1fc6bf676dd78574f, UNASSIGN}] 2023-07-14 11:14:03,779 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=79279148d2b091d8cb3e58b9342bcf92, UNASSIGN 2023-07-14 11:14:03,779 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b65c514e176081c1fc6bf676dd78574f, UNASSIGN 2023-07-14 11:14:03,780 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=b65c514e176081c1fc6bf676dd78574f, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:03,780 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=79279148d2b091d8cb3e58b9342bcf92, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:03,780 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333242501.b65c514e176081c1fc6bf676dd78574f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689333243780"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333243780"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333243780"}]},"ts":"1689333243780"} 2023-07-14 11:14:03,780 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242501.79279148d2b091d8cb3e58b9342bcf92.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689333243780"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333243780"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333243780"}]},"ts":"1689333243780"} 2023-07-14 11:14:03,782 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure b65c514e176081c1fc6bf676dd78574f, server=jenkins-hbase9.apache.org,35929,1689333142490}] 2023-07-14 11:14:03,783 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 79279148d2b091d8cb3e58b9342bcf92, server=jenkins-hbase9.apache.org,46581,1689333142353}] 2023-07-14 11:14:03,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 11:14:03,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close b65c514e176081c1fc6bf676dd78574f 2023-07-14 11:14:03,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing b65c514e176081c1fc6bf676dd78574f, disabling compactions & flushes 2023-07-14 11:14:03,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333242501.b65c514e176081c1fc6bf676dd78574f. 2023-07-14 11:14:03,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333242501.b65c514e176081c1fc6bf676dd78574f. 2023-07-14 11:14:03,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333242501.b65c514e176081c1fc6bf676dd78574f. after waiting 0 ms 2023-07-14 11:14:03,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333242501.b65c514e176081c1fc6bf676dd78574f. 2023-07-14 11:14:03,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing b65c514e176081c1fc6bf676dd78574f 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-14 11:14:03,946 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 79279148d2b091d8cb3e58b9342bcf92 2023-07-14 11:14:03,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 79279148d2b091d8cb3e58b9342bcf92, disabling compactions & flushes 2023-07-14 11:14:03,948 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242501.79279148d2b091d8cb3e58b9342bcf92. 2023-07-14 11:14:03,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242501.79279148d2b091d8cb3e58b9342bcf92. 2023-07-14 11:14:03,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242501.79279148d2b091d8cb3e58b9342bcf92. after waiting 0 ms 2023-07-14 11:14:03,948 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242501.79279148d2b091d8cb3e58b9342bcf92. 2023-07-14 11:14:03,948 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 79279148d2b091d8cb3e58b9342bcf92 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-14 11:14:04,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b65c514e176081c1fc6bf676dd78574f/.tmp/cf/efb81696f2c542529097c1f9987a22da 2023-07-14 11:14:04,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79279148d2b091d8cb3e58b9342bcf92/.tmp/cf/cf6ff8e127cc4c209f135337deef404c 2023-07-14 11:14:04,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79279148d2b091d8cb3e58b9342bcf92/.tmp/cf/cf6ff8e127cc4c209f135337deef404c as hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79279148d2b091d8cb3e58b9342bcf92/cf/cf6ff8e127cc4c209f135337deef404c 2023-07-14 11:14:04,047 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b65c514e176081c1fc6bf676dd78574f/.tmp/cf/efb81696f2c542529097c1f9987a22da as hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b65c514e176081c1fc6bf676dd78574f/cf/efb81696f2c542529097c1f9987a22da 2023-07-14 11:14:04,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 11:14:04,054 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79279148d2b091d8cb3e58b9342bcf92/cf/cf6ff8e127cc4c209f135337deef404c, entries=1, sequenceid=5, filesize=4.7 K 2023-07-14 11:14:04,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 79279148d2b091d8cb3e58b9342bcf92 in 108ms, sequenceid=5, compaction requested=false 2023-07-14 11:14:04,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-14 11:14:04,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b65c514e176081c1fc6bf676dd78574f/cf/efb81696f2c542529097c1f9987a22da, entries=1, sequenceid=5, filesize=4.7 K 2023-07-14 11:14:04,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for b65c514e176081c1fc6bf676dd78574f in 114ms, sequenceid=5, compaction requested=false 2023-07-14 11:14:04,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b65c514e176081c1fc6bf676dd78574f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-14 11:14:04,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:14:04,099 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333242501.b65c514e176081c1fc6bf676dd78574f. 2023-07-14 11:14:04,100 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for b65c514e176081c1fc6bf676dd78574f: 2023-07-14 11:14:04,102 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=b65c514e176081c1fc6bf676dd78574f, regionState=CLOSED 2023-07-14 11:14:04,103 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333242501.b65c514e176081c1fc6bf676dd78574f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689333244102"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333244102"}]},"ts":"1689333244102"} 2023-07-14 11:14:04,103 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed b65c514e176081c1fc6bf676dd78574f 2023-07-14 11:14:04,107 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-14 11:14:04,107 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure b65c514e176081c1fc6bf676dd78574f, server=jenkins-hbase9.apache.org,35929,1689333142490 in 322 msec 2023-07-14 11:14:04,115 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=b65c514e176081c1fc6bf676dd78574f, UNASSIGN in 331 msec 2023-07-14 11:14:04,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79279148d2b091d8cb3e58b9342bcf92/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-14 11:14:04,122 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:14:04,124 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242501.79279148d2b091d8cb3e58b9342bcf92. 2023-07-14 11:14:04,124 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 79279148d2b091d8cb3e58b9342bcf92: 2023-07-14 11:14:04,126 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 79279148d2b091d8cb3e58b9342bcf92 2023-07-14 11:14:04,133 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=79279148d2b091d8cb3e58b9342bcf92, regionState=CLOSED 2023-07-14 11:14:04,133 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242501.79279148d2b091d8cb3e58b9342bcf92.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689333244133"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333244133"}]},"ts":"1689333244133"} 2023-07-14 11:14:04,149 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-14 11:14:04,149 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 79279148d2b091d8cb3e58b9342bcf92, server=jenkins-hbase9.apache.org,46581,1689333142353 in 356 msec 2023-07-14 11:14:04,151 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-07-14 11:14:04,151 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=79279148d2b091d8cb3e58b9342bcf92, UNASSIGN in 376 msec 2023-07-14 11:14:04,326 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d40145739c1bd06c895f33def8ab5193/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-14 11:14:04,329 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242501.79279148d2b091d8cb3e58b9342bcf92.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 11:14:04,329 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689333242501.b65c514e176081c1fc6bf676dd78574f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 11:14:04,329 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242502.d40145739c1bd06c895f33def8ab5193.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-14 11:14:04,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 11:14:04,417 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d40145739c1bd06c895f33def8ab5193, ASSIGN}] 2023-07-14 11:14:04,418 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d40145739c1bd06c895f33def8ab5193, ASSIGN 2023-07-14 11:14:04,421 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d40145739c1bd06c895f33def8ab5193, ASSIGN; state=MERGED, location=jenkins-hbase9.apache.org,46581,1689333142353; forceNewPlan=false, retain=false 2023-07-14 11:14:04,571 INFO [jenkins-hbase9:38311] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-14 11:14:04,577 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=d40145739c1bd06c895f33def8ab5193, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:04,578 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242502.d40145739c1bd06c895f33def8ab5193.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689333244577"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333244577"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333244577"}]},"ts":"1689333244577"} 2023-07-14 11:14:04,581 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure d40145739c1bd06c895f33def8ab5193, server=jenkins-hbase9.apache.org,46581,1689333142353}] 2023-07-14 11:14:04,739 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242502.d40145739c1bd06c895f33def8ab5193. 2023-07-14 11:14:04,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d40145739c1bd06c895f33def8ab5193, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242502.d40145739c1bd06c895f33def8ab5193.', STARTKEY => '', ENDKEY => ''} 2023-07-14 11:14:04,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242502.d40145739c1bd06c895f33def8ab5193. service=AccessControlService 2023-07-14 11:14:04,739 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:14:04,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 d40145739c1bd06c895f33def8ab5193 2023-07-14 11:14:04,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242502.d40145739c1bd06c895f33def8ab5193.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:04,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for d40145739c1bd06c895f33def8ab5193 2023-07-14 11:14:04,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for d40145739c1bd06c895f33def8ab5193 2023-07-14 11:14:04,741 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d40145739c1bd06c895f33def8ab5193/.regioninfo 2023-07-14 11:14:04,774 INFO [StoreOpener-d40145739c1bd06c895f33def8ab5193-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d40145739c1bd06c895f33def8ab5193 2023-07-14 11:14:04,785 DEBUG [StoreOpener-d40145739c1bd06c895f33def8ab5193-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d40145739c1bd06c895f33def8ab5193/cf 2023-07-14 11:14:04,786 DEBUG [StoreOpener-d40145739c1bd06c895f33def8ab5193-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d40145739c1bd06c895f33def8ab5193/cf 2023-07-14 11:14:04,786 INFO [StoreOpener-d40145739c1bd06c895f33def8ab5193-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d40145739c1bd06c895f33def8ab5193 columnFamilyName cf 2023-07-14 11:14:04,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 11:14:04,864 DEBUG [StoreOpener-d40145739c1bd06c895f33def8ab5193-1] regionserver.HStore(539): loaded hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d40145739c1bd06c895f33def8ab5193/cf/cf6ff8e127cc4c209f135337deef404c.79279148d2b091d8cb3e58b9342bcf92->hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79279148d2b091d8cb3e58b9342bcf92/cf/cf6ff8e127cc4c209f135337deef404c-top 2023-07-14 11:14:04,874 DEBUG [StoreOpener-d40145739c1bd06c895f33def8ab5193-1] regionserver.HStore(539): loaded hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d40145739c1bd06c895f33def8ab5193/cf/efb81696f2c542529097c1f9987a22da.b65c514e176081c1fc6bf676dd78574f->hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b65c514e176081c1fc6bf676dd78574f/cf/efb81696f2c542529097c1f9987a22da-top 2023-07-14 11:14:04,875 INFO [StoreOpener-d40145739c1bd06c895f33def8ab5193-1] regionserver.HStore(310): Store=d40145739c1bd06c895f33def8ab5193/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:14:04,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d40145739c1bd06c895f33def8ab5193 2023-07-14 11:14:04,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d40145739c1bd06c895f33def8ab5193 2023-07-14 11:14:04,887 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for d40145739c1bd06c895f33def8ab5193 2023-07-14 11:14:04,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened d40145739c1bd06c895f33def8ab5193; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60373384, jitterRate=-0.10036647319793701}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:14:04,888 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for d40145739c1bd06c895f33def8ab5193: 2023-07-14 11:14:04,889 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242502.d40145739c1bd06c895f33def8ab5193., pid=77, masterSystemTime=1689333244733 2023-07-14 11:14:04,890 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242502.d40145739c1bd06c895f33def8ab5193.,because compaction is disabled. 2023-07-14 11:14:04,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242502.d40145739c1bd06c895f33def8ab5193. 2023-07-14 11:14:04,892 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242502.d40145739c1bd06c895f33def8ab5193. 2023-07-14 11:14:04,893 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=d40145739c1bd06c895f33def8ab5193, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:04,893 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242502.d40145739c1bd06c895f33def8ab5193.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689333244893"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333244893"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333244893"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333244893"}]},"ts":"1689333244893"} 2023-07-14 11:14:04,906 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-14 11:14:04,906 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure d40145739c1bd06c895f33def8ab5193, server=jenkins-hbase9.apache.org,46581,1689333142353 in 320 msec 2023-07-14 11:14:04,909 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-14 11:14:04,909 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d40145739c1bd06c895f33def8ab5193, ASSIGN in 489 msec 2023-07-14 11:14:04,921 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[79279148d2b091d8cb3e58b9342bcf92, b65c514e176081c1fc6bf676dd78574f], force=true in 1.1880 sec 2023-07-14 11:14:05,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-14 11:14:05,858 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-14 11:14:05,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 11:14:05,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689333245859 (current time:1689333245859). 2023-07-14 11:14:05,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 11:14:05,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(139): Connect 0x40aabdc1 to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:14:05,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1043a97a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:14:05,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:05,915 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39306, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:05,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40aabdc1 to 127.0.0.1:58300 2023-07-14 11:14:05,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:14:05,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(139): Connect 0x58374425 to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:14:05,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d66be57, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:14:05,990 DEBUG [hconnection-0x40e3c6f8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:05,995 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:39318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:06,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:06,005 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49954, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:06,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58374425 to 127.0.0.1:58300 2023-07-14 11:14:06,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:14:06,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-14 11:14:06,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 11:14:06,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 11:14:06,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 11:14:06,016 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 11:14:06,018 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689333846018 2023-07-14 11:14:06,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-14 11:14:06,018 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,025 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 11:14:06,025 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 11:14:06,027 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-14 11:14:06,031 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 11:14:06,032 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 13 msec 2023-07-14 11:14:06,039 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 11:14:06,041 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689333846041 2023-07-14 11:14:06,125 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:06,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 11:14:06,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:06,133 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 11:14:06,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,164 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-14 11:14:06,164 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:06,164 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-14 11:14:06,164 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-14 11:14:06,165 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,165 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,223 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:06,223 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:06,223 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:06,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:06,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:06,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:06,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:06,223 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:06,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:06,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:06,224 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:06,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,224 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 11:14:06,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,225 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,225 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,227 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 11:14:06,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 11:14:06,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,228 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 11:14:06,228 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 11:14:06,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-14 11:14:06,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,228 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-14 11:14:06,240 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,241 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 11:14:06,241 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:06,243 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,243 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 11:14:06,261 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,261 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-14 11:14:06,261 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:06,245 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 11:14:06,262 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 11:14:06,262 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46581,1689333142353' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 11:14:06,261 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:06,265 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 11:14:06,265 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 11:14:06,265 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40207,1689333142617' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 11:14:06,267 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-14 11:14:06,267 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-14 11:14:06,267 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35929,1689333142490' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-14 11:14:06,308 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:06,308 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:06,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:06,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:06,333 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:06,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 11:14:06,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:06,334 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 11:14:06,377 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,377 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:06,377 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:06,423 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,424 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:06,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:06,423 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,425 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,425 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:06,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:06,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:06,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:06,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:06,427 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46581,1689333142353' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-14 11:14:06,427 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4464f5b[Count = 0] remaining members to acquire global barrier 2023-07-14 11:14:06,427 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-14 11:14:06,427 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,485 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,485 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,485 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,486 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 11:14:06,486 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 11:14:06,486 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:06,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,486 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 11:14:06,486 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,35929,1689333142490' in zk 2023-07-14 11:14:06,486 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 11:14:06,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,486 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-14 11:14:06,486 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 11:14:06,487 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,40207,1689333142617' in zk 2023-07-14 11:14:06,491 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:14:06,491 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:14:06,491 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242502.d40145739c1bd06c895f33def8ab5193. 2023-07-14 11:14:06,492 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242502.d40145739c1bd06c895f33def8ab5193. started... 2023-07-14 11:14:06,493 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d40145739c1bd06c895f33def8ab5193: 2023-07-14 11:14:06,495 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242502.d40145739c1bd06c895f33def8ab5193.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,495 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:14:06,495 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d40145739c1bd06c895f33def8ab5193/cf/cf6ff8e127cc4c209f135337deef404c.79279148d2b091d8cb3e58b9342bcf92->hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79279148d2b091d8cb3e58b9342bcf92/cf/cf6ff8e127cc4c209f135337deef404c-top, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d40145739c1bd06c895f33def8ab5193/cf/efb81696f2c542529097c1f9987a22da.b65c514e176081c1fc6bf676dd78574f->hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b65c514e176081c1fc6bf676dd78574f/cf/efb81696f2c542529097c1f9987a22da-top] hfiles 2023-07-14 11:14:06,495 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d40145739c1bd06c895f33def8ab5193/cf/cf6ff8e127cc4c209f135337deef404c.79279148d2b091d8cb3e58b9342bcf92 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,502 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d40145739c1bd06c895f33def8ab5193/cf/efb81696f2c542529097c1f9987a22da.b65c514e176081c1fc6bf676dd78574f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,516 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 11:14:06,516 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:06,516 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 11:14:06,539 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 11:14:06,539 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:06,539 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 11:14:06,565 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242502.d40145739c1bd06c895f33def8ab5193. completed. 2023-07-14 11:14:06,565 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242502.d40145739c1bd06c895f33def8ab5193. 2023-07-14 11:14:06,565 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:14:06,566 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:14:06,566 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:06,566 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-14 11:14:06,566 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase9.apache.org,46581,1689333142353' in zk 2023-07-14 11:14:06,635 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:06,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 11:14:06,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:06,636 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 11:14:06,716 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-14 11:14:06,716 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:06,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:06,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:06,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:06,716 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:06,716 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-14 11:14:06,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:06,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:06,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:06,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:06,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:06,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:06,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:06,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:06,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:06,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase9.apache.org,46581,1689333142353': 2023-07-14 11:14:06,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46581,1689333142353' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-14 11:14:06,725 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-14 11:14:06,725 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 11:14:06,725 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 11:14:06,725 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,725 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 11:14:06,769 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,769 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,769 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:06,770 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,770 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:06,770 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,770 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:06,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:06,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:06,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:06,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:06,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:06,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:06,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:06,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:06,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:06,778 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:06,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,779 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:06,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:06,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,780 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:06,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:06,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:06,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:06,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:06,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,784 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:06,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:06,784 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:06,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:06,786 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:06,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:06,823 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:06,823 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,823 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:06,823 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:06,823 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:06,823 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:06,824 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:06,823 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:06,824 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,824 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,824 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:06,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:06,824 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:06,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:06,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:06,825 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,824 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:06,824 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:06,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:06,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:06,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:06,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:06,824 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:06,825 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:06,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:06,826 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,827 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:06,827 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:06,827 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,827 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:06,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:06,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:06,917 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:07,073 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-14 11:14:07,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:07,074 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:07,074 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689333246018Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689333246824 (+806 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689333246824Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689333246838 (+14 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689333246903 (+65 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689333247073 (+170 ms) 2023-07-14 11:14:07,077 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-14 11:14:07,084 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 1.0530 sec 2023-07-14 11:14:07,136 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:07,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-14 11:14:07,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 11:14:07,138 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333247138 2023-07-14 11:14:07,138 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36847, tgtDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333247138, rawTgtDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333247138, srcFsUri=hdfs://localhost:36847, srcDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4 2023-07-14 11:14:07,175 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36847, inputRoot=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4 2023-07-14 11:14:07,175 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_575022054_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333247138, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333247138/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:07,175 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36847, inputRoot=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4, snapshotDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-14 11:14:07,213 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333247138/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:07,359 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:07,359 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:07,359 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:07,360 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:07,360 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:07,360 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:07,360 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:07,535 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/hadoop-5401501877273328423.jar 2023-07-14 11:14:07,536 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:07,537 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:07,537 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:07,538 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:07,538 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:07,539 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:07,539 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 11:14:07,540 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 11:14:07,540 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 11:14:07,541 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 11:14:07,542 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 11:14:07,542 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 11:14:07,543 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 11:14:07,543 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 11:14:07,545 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 11:14:07,545 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 11:14:07,546 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:14:07,547 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:14:07,547 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:14:07,547 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:14:07,548 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:14:07,548 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:14:07,549 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:14:08,567 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 11:14:09,905 WARN [Listener at jenkins-hbase9.apache.org/36907] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 11:14:09,908 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-14 11:14:09,910 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-14 11:14:10,601 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:14:10,601 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:14:10,787 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0005_000001 (auth:SIMPLE) 2023-07-14 11:14:19,980 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0005_000001 (auth:SIMPLE) 2023-07-14 11:14:22,590 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0005_000001 (auth:SIMPLE) 2023-07-14 11:14:32,855 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 11:14:32,868 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 11:14:32,890 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:32,890 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 11:14:32,891 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 11:14:32,891 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1095779325_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:32,891 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-14 11:14:32,892 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-14 11:14:32,892 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1095779325_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333247138/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333247138/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:32,893 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333247138/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-14 11:14:32,893 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333247138/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-14 11:14:32,929 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:32,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:32,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:32,935 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333272935"}]},"ts":"1689333272935"} 2023-07-14 11:14:32,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 11:14:32,937 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-14 11:14:32,940 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-14 11:14:32,941 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d40145739c1bd06c895f33def8ab5193, UNASSIGN}] 2023-07-14 11:14:32,944 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d40145739c1bd06c895f33def8ab5193, UNASSIGN 2023-07-14 11:14:32,947 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=d40145739c1bd06c895f33def8ab5193, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:32,948 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242502.d40145739c1bd06c895f33def8ab5193.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689333272947"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333272947"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333272947"}]},"ts":"1689333272947"} 2023-07-14 11:14:32,949 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure d40145739c1bd06c895f33def8ab5193, server=jenkins-hbase9.apache.org,46581,1689333142353}] 2023-07-14 11:14:33,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 11:14:33,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close d40145739c1bd06c895f33def8ab5193 2023-07-14 11:14:33,102 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing d40145739c1bd06c895f33def8ab5193, disabling compactions & flushes 2023-07-14 11:14:33,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242502.d40145739c1bd06c895f33def8ab5193. 2023-07-14 11:14:33,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242502.d40145739c1bd06c895f33def8ab5193. 2023-07-14 11:14:33,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242502.d40145739c1bd06c895f33def8ab5193. after waiting 0 ms 2023-07-14 11:14:33,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242502.d40145739c1bd06c895f33def8ab5193. 2023-07-14 11:14:33,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d40145739c1bd06c895f33def8ab5193/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-14 11:14:33,119 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:14:33,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242502.d40145739c1bd06c895f33def8ab5193. 2023-07-14 11:14:33,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for d40145739c1bd06c895f33def8ab5193: 2023-07-14 11:14:33,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed d40145739c1bd06c895f33def8ab5193 2023-07-14 11:14:33,125 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=d40145739c1bd06c895f33def8ab5193, regionState=CLOSED 2023-07-14 11:14:33,126 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242502.d40145739c1bd06c895f33def8ab5193.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689333273125"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333273125"}]},"ts":"1689333273125"} 2023-07-14 11:14:33,134 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-14 11:14:33,134 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure d40145739c1bd06c895f33def8ab5193, server=jenkins-hbase9.apache.org,46581,1689333142353 in 179 msec 2023-07-14 11:14:33,136 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-14 11:14:33,136 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=d40145739c1bd06c895f33def8ab5193, UNASSIGN in 193 msec 2023-07-14 11:14:33,137 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333273136"}]},"ts":"1689333273136"} 2023-07-14 11:14:33,138 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-14 11:14:33,139 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-14 11:14:33,141 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 210 msec 2023-07-14 11:14:33,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-14 11:14:33,238 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-14 11:14:33,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,243 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,244 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,246 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46581] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,251 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,251 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,251 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,251 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,254 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-14 11:14:33,254 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-14 11:14:33,255 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,255 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:33,255 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-14 11:14:33,255 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:33,255 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,255 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:33,255 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 11:14:33,256 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:33,256 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-14 11:14:33,256 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 11:14:33,257 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:33,257 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:33,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-14 11:14:33,258 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:33,259 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:33,261 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79279148d2b091d8cb3e58b9342bcf92 2023-07-14 11:14:33,264 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d40145739c1bd06c895f33def8ab5193 2023-07-14 11:14:33,270 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b65c514e176081c1fc6bf676dd78574f 2023-07-14 11:14:33,278 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d40145739c1bd06c895f33def8ab5193/cf, FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d40145739c1bd06c895f33def8ab5193/recovered.edits] 2023-07-14 11:14:33,279 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b65c514e176081c1fc6bf676dd78574f/cf, FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b65c514e176081c1fc6bf676dd78574f/recovered.edits] 2023-07-14 11:14:33,279 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79279148d2b091d8cb3e58b9342bcf92/cf, FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79279148d2b091d8cb3e58b9342bcf92/recovered.edits] 2023-07-14 11:14:33,295 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d40145739c1bd06c895f33def8ab5193/cf/cf6ff8e127cc4c209f135337deef404c.79279148d2b091d8cb3e58b9342bcf92 to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d40145739c1bd06c895f33def8ab5193/cf/cf6ff8e127cc4c209f135337deef404c.79279148d2b091d8cb3e58b9342bcf92 2023-07-14 11:14:33,296 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79279148d2b091d8cb3e58b9342bcf92/cf/cf6ff8e127cc4c209f135337deef404c to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79279148d2b091d8cb3e58b9342bcf92/cf/cf6ff8e127cc4c209f135337deef404c 2023-07-14 11:14:33,299 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d40145739c1bd06c895f33def8ab5193/cf/efb81696f2c542529097c1f9987a22da.b65c514e176081c1fc6bf676dd78574f to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d40145739c1bd06c895f33def8ab5193/cf/efb81696f2c542529097c1f9987a22da.b65c514e176081c1fc6bf676dd78574f 2023-07-14 11:14:33,299 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b65c514e176081c1fc6bf676dd78574f/cf/efb81696f2c542529097c1f9987a22da to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b65c514e176081c1fc6bf676dd78574f/cf/efb81696f2c542529097c1f9987a22da 2023-07-14 11:14:33,304 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b65c514e176081c1fc6bf676dd78574f/recovered.edits/8.seqid to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b65c514e176081c1fc6bf676dd78574f/recovered.edits/8.seqid 2023-07-14 11:14:33,306 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/b65c514e176081c1fc6bf676dd78574f 2023-07-14 11:14:33,306 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79279148d2b091d8cb3e58b9342bcf92/recovered.edits/8.seqid to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79279148d2b091d8cb3e58b9342bcf92/recovered.edits/8.seqid 2023-07-14 11:14:33,306 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/79279148d2b091d8cb3e58b9342bcf92 2023-07-14 11:14:33,307 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d40145739c1bd06c895f33def8ab5193/recovered.edits/12.seqid to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d40145739c1bd06c895f33def8ab5193/recovered.edits/12.seqid 2023-07-14 11:14:33,308 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/d40145739c1bd06c895f33def8ab5193 2023-07-14 11:14:33,308 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-14 11:14:33,311 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,325 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-14 11:14:33,335 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-14 11:14:33,337 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,337 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-14 11:14:33,337 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242502.d40145739c1bd06c895f33def8ab5193.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689333273337"}]},"ts":"9223372036854775807"} 2023-07-14 11:14:33,351 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-14 11:14:33,352 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d40145739c1bd06c895f33def8ab5193, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689333242502.d40145739c1bd06c895f33def8ab5193.', STARTKEY => '', ENDKEY => ''}] 2023-07-14 11:14:33,352 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-14 11:14:33,352 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689333273352"}]},"ts":"9223372036854775807"} 2023-07-14 11:14:33,357 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-14 11:14:33,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-14 11:14:33,363 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:33,365 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 124 msec 2023-07-14 11:14:33,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-14 11:14:33,561 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-14 11:14:33,561 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:33,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:33,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:33,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 11:14:33,570 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333273570"}]},"ts":"1689333273570"} 2023-07-14 11:14:33,572 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-14 11:14:33,574 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-14 11:14:33,575 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c064228e507ec203ef0dbdaa998370bd, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8c02737a08abfdba8d1f25cacbe44d6b, UNASSIGN}] 2023-07-14 11:14:33,577 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c064228e507ec203ef0dbdaa998370bd, UNASSIGN 2023-07-14 11:14:33,577 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8c02737a08abfdba8d1f25cacbe44d6b, UNASSIGN 2023-07-14 11:14:33,578 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=c064228e507ec203ef0dbdaa998370bd, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:33,578 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=8c02737a08abfdba8d1f25cacbe44d6b, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:33,578 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689333273578"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333273578"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333273578"}]},"ts":"1689333273578"} 2023-07-14 11:14:33,578 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689333273578"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333273578"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333273578"}]},"ts":"1689333273578"} 2023-07-14 11:14:33,580 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 8c02737a08abfdba8d1f25cacbe44d6b, server=jenkins-hbase9.apache.org,40207,1689333142617}] 2023-07-14 11:14:33,581 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure c064228e507ec203ef0dbdaa998370bd, server=jenkins-hbase9.apache.org,35929,1689333142490}] 2023-07-14 11:14:33,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 11:14:33,733 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 8c02737a08abfdba8d1f25cacbe44d6b 2023-07-14 11:14:33,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 8c02737a08abfdba8d1f25cacbe44d6b, disabling compactions & flushes 2023-07-14 11:14:33,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b. 2023-07-14 11:14:33,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b. 2023-07-14 11:14:33,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b. after waiting 0 ms 2023-07-14 11:14:33,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b. 2023-07-14 11:14:33,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close c064228e507ec203ef0dbdaa998370bd 2023-07-14 11:14:33,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing c064228e507ec203ef0dbdaa998370bd, disabling compactions & flushes 2023-07-14 11:14:33,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd. 2023-07-14 11:14:33,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd. 2023-07-14 11:14:33,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd. after waiting 0 ms 2023-07-14 11:14:33,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd. 2023-07-14 11:14:33,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion/c064228e507ec203ef0dbdaa998370bd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 11:14:33,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:14:33,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd. 2023-07-14 11:14:33,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithMergeRegion/8c02737a08abfdba8d1f25cacbe44d6b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 11:14:33,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for c064228e507ec203ef0dbdaa998370bd: 2023-07-14 11:14:33,769 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:14:33,770 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b. 2023-07-14 11:14:33,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 8c02737a08abfdba8d1f25cacbe44d6b: 2023-07-14 11:14:33,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed c064228e507ec203ef0dbdaa998370bd 2023-07-14 11:14:33,773 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=c064228e507ec203ef0dbdaa998370bd, regionState=CLOSED 2023-07-14 11:14:33,773 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 8c02737a08abfdba8d1f25cacbe44d6b 2023-07-14 11:14:33,773 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689333273773"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333273773"}]},"ts":"1689333273773"} 2023-07-14 11:14:33,774 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=8c02737a08abfdba8d1f25cacbe44d6b, regionState=CLOSED 2023-07-14 11:14:33,774 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689333273774"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333273774"}]},"ts":"1689333273774"} 2023-07-14 11:14:33,777 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-14 11:14:33,777 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure c064228e507ec203ef0dbdaa998370bd, server=jenkins-hbase9.apache.org,35929,1689333142490 in 194 msec 2023-07-14 11:14:33,778 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-14 11:14:33,778 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 8c02737a08abfdba8d1f25cacbe44d6b, server=jenkins-hbase9.apache.org,40207,1689333142617 in 196 msec 2023-07-14 11:14:33,778 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=c064228e507ec203ef0dbdaa998370bd, UNASSIGN in 202 msec 2023-07-14 11:14:33,779 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-14 11:14:33,780 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=8c02737a08abfdba8d1f25cacbe44d6b, UNASSIGN in 203 msec 2023-07-14 11:14:33,780 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333273780"}]},"ts":"1689333273780"} 2023-07-14 11:14:33,782 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-14 11:14:33,783 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-14 11:14:33,785 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 222 msec 2023-07-14 11:14:33,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-14 11:14:33,874 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-14 11:14:33,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:33,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:33,879 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:33,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:33,881 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:33,882 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46581] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:33,887 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:33,887 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:33,887 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:33,887 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:33,888 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 11:14:33,888 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 11:14:33,888 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 11:14:33,888 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c064228e507ec203ef0dbdaa998370bd 2023-07-14 11:14:33,889 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-14 11:14:33,891 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:33,891 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:33,891 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:33,891 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:33,892 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:33,892 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:33,892 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:33,892 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:33,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-14 11:14:33,898 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8c02737a08abfdba8d1f25cacbe44d6b 2023-07-14 11:14:33,898 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c064228e507ec203ef0dbdaa998370bd/cf, FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c064228e507ec203ef0dbdaa998370bd/recovered.edits] 2023-07-14 11:14:33,900 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8c02737a08abfdba8d1f25cacbe44d6b/cf, FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8c02737a08abfdba8d1f25cacbe44d6b/recovered.edits] 2023-07-14 11:14:33,904 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c064228e507ec203ef0dbdaa998370bd/cf/48508517046441fb80422684bcd33912 to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c064228e507ec203ef0dbdaa998370bd/cf/48508517046441fb80422684bcd33912 2023-07-14 11:14:33,905 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8c02737a08abfdba8d1f25cacbe44d6b/cf/e99e6e6c4a214eb88bb40d9187e2abc6 to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/8c02737a08abfdba8d1f25cacbe44d6b/cf/e99e6e6c4a214eb88bb40d9187e2abc6 2023-07-14 11:14:33,907 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c064228e507ec203ef0dbdaa998370bd/recovered.edits/9.seqid to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/c064228e507ec203ef0dbdaa998370bd/recovered.edits/9.seqid 2023-07-14 11:14:33,909 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/c064228e507ec203ef0dbdaa998370bd 2023-07-14 11:14:33,911 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8c02737a08abfdba8d1f25cacbe44d6b/recovered.edits/9.seqid to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/8c02737a08abfdba8d1f25cacbe44d6b/recovered.edits/9.seqid 2023-07-14 11:14:33,912 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/8c02737a08abfdba8d1f25cacbe44d6b 2023-07-14 11:14:33,912 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-14 11:14:33,916 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:33,920 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-14 11:14:33,923 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-14 11:14:33,924 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:33,924 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-14 11:14:33,924 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689333273924"}]},"ts":"9223372036854775807"} 2023-07-14 11:14:33,924 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689333273924"}]},"ts":"9223372036854775807"} 2023-07-14 11:14:33,926 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 11:14:33,926 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c064228e507ec203ef0dbdaa998370bd, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689333238300.c064228e507ec203ef0dbdaa998370bd.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8c02737a08abfdba8d1f25cacbe44d6b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689333238300.8c02737a08abfdba8d1f25cacbe44d6b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 11:14:33,926 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-14 11:14:33,926 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689333273926"}]},"ts":"9223372036854775807"} 2023-07-14 11:14:33,927 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-14 11:14:33,929 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:33,931 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 54 msec 2023-07-14 11:14:33,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-14 11:14:33,995 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-14 11:14:34,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-14 11:14:34,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:34,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-14 11:14:34,010 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-14 11:14:34,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-14 11:14:34,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-14 11:14:34,053 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 747) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1095779325_17 at /127.0.0.1:39336 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49bc206a-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase9.apache.org/172.31.2.10:37809 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase9.apache.org/172.31.2.10:40409 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49bc206a-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3949 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1095779325_17 at /127.0.0.1:35178 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1095779325_17 at /127.0.0.1:55756 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase9:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1095779325_17 at /127.0.0.1:35176 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49bc206a-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1796202517_1 at /127.0.0.1:52968 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49bc206a-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49bc206a-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49bc206a-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=903 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1447 (was 1193) - SystemLoadAverage LEAK? -, ProcessCount=192 (was 192), AvailableMemoryMB=1093 (was 1356) 2023-07-14 11:14:34,053 WARN [Listener at jenkins-hbase9.apache.org/36907] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-14 11:14:34,079 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=1447, ProcessCount=192, AvailableMemoryMB=1092 2023-07-14 11:14:34,079 WARN [Listener at jenkins-hbase9.apache.org/36907] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-14 11:14:34,081 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 11:14:34,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 11:14:34,089 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 11:14:34,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-14 11:14:34,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 11:14:34,091 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 11:14:34,095 DEBUG [HFileArchiver-24] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testEmptyExportFileSystemState/8c3c95a6ac7b8e5153b0f2de76e2474b 2023-07-14 11:14:34,096 DEBUG [HFileArchiver-24] backup.HFileArchiver(153): Directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testEmptyExportFileSystemState/8c3c95a6ac7b8e5153b0f2de76e2474b empty. 2023-07-14 11:14:34,097 DEBUG [HFileArchiver-24] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testEmptyExportFileSystemState/8c3c95a6ac7b8e5153b0f2de76e2474b 2023-07-14 11:14:34,097 DEBUG [HFileArchiver-25] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testEmptyExportFileSystemState/740b82d7df1422bbeeb99ad284ae8706 2023-07-14 11:14:34,098 DEBUG [HFileArchiver-25] backup.HFileArchiver(153): Directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testEmptyExportFileSystemState/740b82d7df1422bbeeb99ad284ae8706 empty. 2023-07-14 11:14:34,098 DEBUG [HFileArchiver-25] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testEmptyExportFileSystemState/740b82d7df1422bbeeb99ad284ae8706 2023-07-14 11:14:34,099 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-14 11:14:34,133 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-14 11:14:34,135 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8c3c95a6ac7b8e5153b0f2de76e2474b, NAME => 'testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp 2023-07-14 11:14:34,135 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 740b82d7df1422bbeeb99ad284ae8706, NAME => 'testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp 2023-07-14 11:14:34,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 11:14:34,203 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:34,203 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 740b82d7df1422bbeeb99ad284ae8706, disabling compactions & flushes 2023-07-14 11:14:34,203 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706. 2023-07-14 11:14:34,203 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706. 2023-07-14 11:14:34,203 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706. after waiting 0 ms 2023-07-14 11:14:34,203 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706. 2023-07-14 11:14:34,203 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706. 2023-07-14 11:14:34,203 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 740b82d7df1422bbeeb99ad284ae8706: 2023-07-14 11:14:34,205 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:34,205 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 8c3c95a6ac7b8e5153b0f2de76e2474b, disabling compactions & flushes 2023-07-14 11:14:34,205 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b. 2023-07-14 11:14:34,205 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b. 2023-07-14 11:14:34,205 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b. after waiting 0 ms 2023-07-14 11:14:34,205 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b. 2023-07-14 11:14:34,205 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b. 2023-07-14 11:14:34,205 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 8c3c95a6ac7b8e5153b0f2de76e2474b: 2023-07-14 11:14:34,209 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 11:14:34,211 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689333274211"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333274211"}]},"ts":"1689333274211"} 2023-07-14 11:14:34,211 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689333274211"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333274211"}]},"ts":"1689333274211"} 2023-07-14 11:14:34,215 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 11:14:34,216 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 11:14:34,216 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333274216"}]},"ts":"1689333274216"} 2023-07-14 11:14:34,218 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-14 11:14:34,221 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 11:14:34,222 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 11:14:34,223 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 11:14:34,223 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 11:14:34,223 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 11:14:34,223 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8c3c95a6ac7b8e5153b0f2de76e2474b, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=740b82d7df1422bbeeb99ad284ae8706, ASSIGN}] 2023-07-14 11:14:34,230 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8c3c95a6ac7b8e5153b0f2de76e2474b, ASSIGN 2023-07-14 11:14:34,230 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=740b82d7df1422bbeeb99ad284ae8706, ASSIGN 2023-07-14 11:14:34,231 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=740b82d7df1422bbeeb99ad284ae8706, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,40207,1689333142617; forceNewPlan=false, retain=false 2023-07-14 11:14:34,231 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8c3c95a6ac7b8e5153b0f2de76e2474b, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46581,1689333142353; forceNewPlan=false, retain=false 2023-07-14 11:14:34,381 INFO [jenkins-hbase9:38311] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 11:14:34,385 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=8c3c95a6ac7b8e5153b0f2de76e2474b, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:34,385 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=740b82d7df1422bbeeb99ad284ae8706, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:34,385 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689333274385"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333274385"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333274385"}]},"ts":"1689333274385"} 2023-07-14 11:14:34,385 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689333274385"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333274385"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333274385"}]},"ts":"1689333274385"} 2023-07-14 11:14:34,388 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 8c3c95a6ac7b8e5153b0f2de76e2474b, server=jenkins-hbase9.apache.org,46581,1689333142353}] 2023-07-14 11:14:34,390 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 740b82d7df1422bbeeb99ad284ae8706, server=jenkins-hbase9.apache.org,40207,1689333142617}] 2023-07-14 11:14:34,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 11:14:34,552 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b. 2023-07-14 11:14:34,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8c3c95a6ac7b8e5153b0f2de76e2474b, NAME => 'testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 11:14:34,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b. service=AccessControlService 2023-07-14 11:14:34,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:14:34,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 8c3c95a6ac7b8e5153b0f2de76e2474b 2023-07-14 11:14:34,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:34,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 8c3c95a6ac7b8e5153b0f2de76e2474b 2023-07-14 11:14:34,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 8c3c95a6ac7b8e5153b0f2de76e2474b 2023-07-14 11:14:34,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706. 2023-07-14 11:14:34,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 740b82d7df1422bbeeb99ad284ae8706, NAME => 'testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 11:14:34,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706. service=AccessControlService 2023-07-14 11:14:34,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:14:34,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 740b82d7df1422bbeeb99ad284ae8706 2023-07-14 11:14:34,559 INFO [StoreOpener-8c3c95a6ac7b8e5153b0f2de76e2474b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8c3c95a6ac7b8e5153b0f2de76e2474b 2023-07-14 11:14:34,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:34,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 740b82d7df1422bbeeb99ad284ae8706 2023-07-14 11:14:34,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 740b82d7df1422bbeeb99ad284ae8706 2023-07-14 11:14:34,565 INFO [StoreOpener-740b82d7df1422bbeeb99ad284ae8706-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 740b82d7df1422bbeeb99ad284ae8706 2023-07-14 11:14:34,571 DEBUG [StoreOpener-8c3c95a6ac7b8e5153b0f2de76e2474b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testEmptyExportFileSystemState/8c3c95a6ac7b8e5153b0f2de76e2474b/cf 2023-07-14 11:14:34,571 DEBUG [StoreOpener-740b82d7df1422bbeeb99ad284ae8706-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testEmptyExportFileSystemState/740b82d7df1422bbeeb99ad284ae8706/cf 2023-07-14 11:14:34,571 DEBUG [StoreOpener-8c3c95a6ac7b8e5153b0f2de76e2474b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testEmptyExportFileSystemState/8c3c95a6ac7b8e5153b0f2de76e2474b/cf 2023-07-14 11:14:34,571 DEBUG [StoreOpener-740b82d7df1422bbeeb99ad284ae8706-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testEmptyExportFileSystemState/740b82d7df1422bbeeb99ad284ae8706/cf 2023-07-14 11:14:34,572 INFO [StoreOpener-8c3c95a6ac7b8e5153b0f2de76e2474b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8c3c95a6ac7b8e5153b0f2de76e2474b columnFamilyName cf 2023-07-14 11:14:34,573 INFO [StoreOpener-8c3c95a6ac7b8e5153b0f2de76e2474b-1] regionserver.HStore(310): Store=8c3c95a6ac7b8e5153b0f2de76e2474b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:14:34,573 INFO [StoreOpener-740b82d7df1422bbeeb99ad284ae8706-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 740b82d7df1422bbeeb99ad284ae8706 columnFamilyName cf 2023-07-14 11:14:34,574 INFO [StoreOpener-740b82d7df1422bbeeb99ad284ae8706-1] regionserver.HStore(310): Store=740b82d7df1422bbeeb99ad284ae8706/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:14:34,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testEmptyExportFileSystemState/8c3c95a6ac7b8e5153b0f2de76e2474b 2023-07-14 11:14:34,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testEmptyExportFileSystemState/8c3c95a6ac7b8e5153b0f2de76e2474b 2023-07-14 11:14:34,575 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testEmptyExportFileSystemState/740b82d7df1422bbeeb99ad284ae8706 2023-07-14 11:14:34,576 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testEmptyExportFileSystemState/740b82d7df1422bbeeb99ad284ae8706 2023-07-14 11:14:34,588 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 8c3c95a6ac7b8e5153b0f2de76e2474b 2023-07-14 11:14:34,593 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 740b82d7df1422bbeeb99ad284ae8706 2023-07-14 11:14:34,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testEmptyExportFileSystemState/8c3c95a6ac7b8e5153b0f2de76e2474b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:14:34,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testEmptyExportFileSystemState/740b82d7df1422bbeeb99ad284ae8706/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:14:34,602 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 8c3c95a6ac7b8e5153b0f2de76e2474b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58877509, jitterRate=-0.12265674769878387}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:14:34,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 8c3c95a6ac7b8e5153b0f2de76e2474b: 2023-07-14 11:14:34,605 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b., pid=93, masterSystemTime=1689333274542 2023-07-14 11:14:34,606 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 740b82d7df1422bbeeb99ad284ae8706; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72361408, jitterRate=0.07826900482177734}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:14:34,606 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 740b82d7df1422bbeeb99ad284ae8706: 2023-07-14 11:14:34,608 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706., pid=94, masterSystemTime=1689333274550 2023-07-14 11:14:34,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b. 2023-07-14 11:14:34,608 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b. 2023-07-14 11:14:34,609 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=8c3c95a6ac7b8e5153b0f2de76e2474b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:34,609 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689333274608"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333274608"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333274608"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333274608"}]},"ts":"1689333274608"} 2023-07-14 11:14:34,609 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706. 2023-07-14 11:14:34,609 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706. 2023-07-14 11:14:34,611 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=740b82d7df1422bbeeb99ad284ae8706, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:34,611 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689333274611"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333274611"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333274611"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333274611"}]},"ts":"1689333274611"} 2023-07-14 11:14:34,615 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-14 11:14:34,615 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 8c3c95a6ac7b8e5153b0f2de76e2474b, server=jenkins-hbase9.apache.org,46581,1689333142353 in 222 msec 2023-07-14 11:14:34,617 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-14 11:14:34,617 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8c3c95a6ac7b8e5153b0f2de76e2474b, ASSIGN in 392 msec 2023-07-14 11:14:34,617 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 740b82d7df1422bbeeb99ad284ae8706, server=jenkins-hbase9.apache.org,40207,1689333142617 in 223 msec 2023-07-14 11:14:34,619 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=90 2023-07-14 11:14:34,619 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=740b82d7df1422bbeeb99ad284ae8706, ASSIGN in 394 msec 2023-07-14 11:14:34,626 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 11:14:34,626 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333274626"}]},"ts":"1689333274626"} 2023-07-14 11:14:34,627 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-14 11:14:34,634 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 11:14:34,635 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-14 11:14:34,637 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46581] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 11:14:34,639 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:34,639 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:34,639 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:34,639 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:34,642 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:34,643 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:34,644 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:34,645 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 561 msec 2023-07-14 11:14:34,646 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:34,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-14 11:14:34,695 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-14 11:14:34,695 DEBUG [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-14 11:14:34,696 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:14:34,707 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-14 11:14:34,707 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:14:34,707 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-14 11:14:34,715 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 11:14:34,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689333274715 (current time:1689333274715). 2023-07-14 11:14:34,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 11:14:34,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(139): Connect 0x226669f0 to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:14:34,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d0be302, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:14:34,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:34,778 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48900, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:34,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x226669f0 to 127.0.0.1:58300 2023-07-14 11:14:34,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:14:34,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(139): Connect 0x6a09a6db to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:14:34,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bb17b83, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:14:34,802 DEBUG [hconnection-0x79a09404-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:34,803 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48902, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:34,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:34,815 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:34,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a09a6db to 127.0.0.1:58300 2023-07-14 11:14:34,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:14:34,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 11:14:34,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 11:14:34,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 11:14:34,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 11:14:34,821 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 11:14:34,822 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689333874822 2023-07-14 11:14:34,822 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-14 11:14:34,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 11:14:34,823 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 11:14:34,823 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 11:14:34,827 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 11:14:34,830 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 11:14:34,834 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-14 11:14:34,838 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 11:14:34,840 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689333874840 2023-07-14 11:14:34,913 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,914 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-14 11:14:34,914 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:34,916 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-14 11:14:34,916 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-14 11:14:34,916 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,916 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,923 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:34,924 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:34,924 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:34,924 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:34,924 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:34,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:34,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:34,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:34,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:34,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:34,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 11:14:34,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:34,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:34,924 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:34,925 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:34,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,925 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,925 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,925 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:34,925 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 11:14:34,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 11:14:34,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,926 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 11:14:34,925 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 11:14:34,926 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 11:14:34,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,926 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 11:14:34,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-14 11:14:34,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,927 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 11:14:34,929 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,930 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 11:14:34,930 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:34,931 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,931 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 11:14:34,933 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 11:14:34,933 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,933 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:34,933 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 11:14:34,933 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 11:14:34,934 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:34,934 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 11:14:34,936 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 11:14:34,936 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 11:14:34,936 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35929,1689333142490' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 11:14:34,934 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46581,1689333142353' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 11:14:34,936 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 11:14:34,936 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40207,1689333142617' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 11:14:34,939 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,940 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:34,939 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:34,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:34,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:34,941 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:34,941 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,941 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:34,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:34,941 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,941 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:34,941 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:34,942 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,942 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:34,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:34,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:34,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:34,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:34,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46581,1689333142353' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 11:14:34,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ddd68ca[Count = 1] remaining members to acquire global barrier 2023-07-14 11:14:34,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:34,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:34,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:34,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:34,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:34,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:34,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:34,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:34,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:34,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40207,1689333142617' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 11:14:34,948 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7ddd68ca[Count = 0] remaining members to acquire global barrier 2023-07-14 11:14:34,948 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 11:14:34,948 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,950 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,950 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,950 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,950 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 11:14:34,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,950 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:34,950 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 11:14:34,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,950 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 11:14:34,950 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 11:14:34,950 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,35929,1689333142490' in zk 2023-07-14 11:14:34,951 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:34,951 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 11:14:34,952 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 11:14:34,952 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:34,952 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 11:14:34,961 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:14:34,961 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:14:34,962 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b. 2023-07-14 11:14:34,977 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:14:34,978 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:14:34,978 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706. 2023-07-14 11:14:34,978 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706. started... 2023-07-14 11:14:34,981 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b. started... 2023-07-14 11:14:34,981 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 740b82d7df1422bbeeb99ad284ae8706: 2023-07-14 11:14:34,983 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8c3c95a6ac7b8e5153b0f2de76e2474b: 2023-07-14 11:14:34,983 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,983 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:34,983 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:14:34,983 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 11:14:34,983 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:14:34,984 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 11:14:35,046 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706. completed. 2023-07-14 11:14:35,046 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706. 2023-07-14 11:14:35,046 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:14:35,047 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:14:35,047 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,047 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 11:14:35,047 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,40207,1689333142617' in zk 2023-07-14 11:14:35,049 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,049 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 11:14:35,049 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:35,049 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 11:14:35,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:35,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:35,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:35,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:35,059 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b. completed. 2023-07-14 11:14:35,059 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b. 2023-07-14 11:14:35,059 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:14:35,059 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:14:35,059 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,059 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 11:14:35,059 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,46581,1689333142353' in zk 2023-07-14 11:14:35,061 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 11:14:35,061 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:35,062 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,062 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 11:14:35,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:35,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:35,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:35,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,40207,1689333142617': 2023-07-14 11:14:35,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40207,1689333142617' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 11:14:35,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:35,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:35,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:35,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:35,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:35,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:35,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:35,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,46581,1689333142353': 2023-07-14 11:14:35,076 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46581,1689333142353' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 11:14:35,076 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-14 11:14:35,076 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 11:14:35,076 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 11:14:35,077 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,077 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 11:14:35,079 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,079 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,079 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,079 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:35,079 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,079 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:35,079 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:35,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:35,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:35,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,080 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:35,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:35,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:35,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:35,080 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:35,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:35,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:35,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,081 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:35,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:35,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:35,084 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:35,084 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,084 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:35,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:35,088 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:35,088 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,088 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,088 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:35,089 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:35,089 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:35,089 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:35,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:35,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:35,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:35,089 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:35,089 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:35,089 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,091 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:35,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:35,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:35,089 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:35,089 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,092 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,092 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:35,092 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,092 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,092 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,092 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,092 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,092 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:35,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:35,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:35,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:35,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:35,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:35,125 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:35,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 11:14:35,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:35,128 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 11:14:35,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,257 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-14 11:14:35,257 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,258 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689333274822Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689333275091 (+269 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689333275092 (+1 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689333275129 (+37 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689333275175 (+46 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689333275257 (+82 ms) 2023-07-14 11:14:35,263 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 11:14:35,268 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 437 msec 2023-07-14 11:14:35,428 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:35,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 11:14:35,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 11:14:35,438 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40207] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 11:14:35,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46581] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 11:14:35,446 DEBUG [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-14 11:14:35,446 DEBUG [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b. 2023-07-14 11:14:35,446 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:14:35,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 11:14:35,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689333275468 (current time:1689333275468). 2023-07-14 11:14:35,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 11:14:35,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(139): Connect 0x2b7a1c67 to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:14:35,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5607adb8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:14:35,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:35,481 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:35,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2b7a1c67 to 127.0.0.1:58300 2023-07-14 11:14:35,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:14:35,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(139): Connect 0x338b4a54 to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:14:35,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48e9f166, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:14:35,497 DEBUG [hconnection-0x23e8efae-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:35,504 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:48914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:35,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:35,512 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:49570, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:35,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x338b4a54 to 127.0.0.1:58300 2023-07-14 11:14:35,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:14:35,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-14 11:14:35,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 11:14:35,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 11:14:35,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 11:14:35,522 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 11:14:35,523 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689333875523 2023-07-14 11:14:35,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-14 11:14:35,523 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-14 11:14:35,525 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 11:14:35,525 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 11:14:35,527 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 11:14:35,527 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-14 11:14:35,528 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-14 11:14:35,529 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 11:14:35,538 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689333875538 2023-07-14 11:14:35,569 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,569 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-14 11:14:35,569 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:35,571 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-14 11:14:35,571 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-14 11:14:35,572 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,572 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,573 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:35,573 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:35,573 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:35,573 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:35,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:35,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:35,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:35,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:35,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:35,574 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,574 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,574 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 11:14:35,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,575 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,575 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 11:14:35,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 11:14:35,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-14 11:14:35,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,576 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 11:14:35,576 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 11:14:35,576 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,576 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 11:14:35,576 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:35,577 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-14 11:14:35,577 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,578 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 11:14:35,578 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:35,585 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,587 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 11:14:35,587 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-14 11:14:35,587 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:35,587 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 11:14:35,587 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 11:14:35,587 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46581,1689333142353' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 11:14:35,587 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 11:14:35,588 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40207,1689333142617' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 11:14:35,592 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-14 11:14:35,592 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-14 11:14:35,592 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35929,1689333142490' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-14 11:14:35,595 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,595 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:35,595 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,595 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,595 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:35,595 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:35,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:35,596 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,596 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:35,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:35,597 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:35,598 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,598 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:35,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46581,1689333142353' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 11:14:35,598 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@945bdfe[Count = 1] remaining members to acquire global barrier 2023-07-14 11:14:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:35,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:35,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:35,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:35,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,40207,1689333142617' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-14 11:14:35,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@945bdfe[Count = 0] remaining members to acquire global barrier 2023-07-14 11:14:35,600 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-14 11:14:35,600 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,607 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,607 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,607 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,607 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 11:14:35,607 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,607 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 11:14:35,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,608 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-14 11:14:35,608 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 11:14:35,608 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,608 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 11:14:35,608 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,35929,1689333142490' in zk 2023-07-14 11:14:35,609 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:14:35,609 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:14:35,610 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:14:35,610 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:14:35,610 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 11:14:35,610 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:35,610 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b. 2023-07-14 11:14:35,610 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 11:14:35,610 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b. started... 2023-07-14 11:14:35,610 INFO [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 8c3c95a6ac7b8e5153b0f2de76e2474b 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-14 11:14:35,612 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706. 2023-07-14 11:14:35,612 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706. started... 2023-07-14 11:14:35,613 INFO [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 740b82d7df1422bbeeb99ad284ae8706 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-14 11:14:35,625 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:35,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 11:14:35,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:35,626 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 11:14:35,668 INFO [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testEmptyExportFileSystemState/8c3c95a6ac7b8e5153b0f2de76e2474b/.tmp/cf/3b5b8b67ca3e4d58bd4202fbbbcec00c 2023-07-14 11:14:35,686 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testEmptyExportFileSystemState/8c3c95a6ac7b8e5153b0f2de76e2474b/.tmp/cf/3b5b8b67ca3e4d58bd4202fbbbcec00c as hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testEmptyExportFileSystemState/8c3c95a6ac7b8e5153b0f2de76e2474b/cf/3b5b8b67ca3e4d58bd4202fbbbcec00c 2023-07-14 11:14:35,705 INFO [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testEmptyExportFileSystemState/8c3c95a6ac7b8e5153b0f2de76e2474b/cf/3b5b8b67ca3e4d58bd4202fbbbcec00c, entries=5, sequenceid=6, filesize=5.2 K 2023-07-14 11:14:35,706 INFO [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 8c3c95a6ac7b8e5153b0f2de76e2474b in 96ms, sequenceid=6, compaction requested=false 2023-07-14 11:14:35,706 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-14 11:14:35,706 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 8c3c95a6ac7b8e5153b0f2de76e2474b: 2023-07-14 11:14:35,706 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,707 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:14:35,707 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testEmptyExportFileSystemState/8c3c95a6ac7b8e5153b0f2de76e2474b/cf/3b5b8b67ca3e4d58bd4202fbbbcec00c] hfiles 2023-07-14 11:14:35,707 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testEmptyExportFileSystemState/8c3c95a6ac7b8e5153b0f2de76e2474b/cf/3b5b8b67ca3e4d58bd4202fbbbcec00c for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,714 INFO [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testEmptyExportFileSystemState/740b82d7df1422bbeeb99ad284ae8706/.tmp/cf/81b930bdf01041548cb303bda48ab875 2023-07-14 11:14:35,724 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testEmptyExportFileSystemState/740b82d7df1422bbeeb99ad284ae8706/.tmp/cf/81b930bdf01041548cb303bda48ab875 as hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testEmptyExportFileSystemState/740b82d7df1422bbeeb99ad284ae8706/cf/81b930bdf01041548cb303bda48ab875 2023-07-14 11:14:35,730 INFO [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testEmptyExportFileSystemState/740b82d7df1422bbeeb99ad284ae8706/cf/81b930bdf01041548cb303bda48ab875, entries=45, sequenceid=6, filesize=7.9 K 2023-07-14 11:14:35,730 INFO [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 740b82d7df1422bbeeb99ad284ae8706 in 117ms, sequenceid=6, compaction requested=false 2023-07-14 11:14:35,738 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 740b82d7df1422bbeeb99ad284ae8706: 2023-07-14 11:14:35,738 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,738 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:14:35,738 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testEmptyExportFileSystemState/740b82d7df1422bbeeb99ad284ae8706/cf/81b930bdf01041548cb303bda48ab875] hfiles 2023-07-14 11:14:35,738 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testEmptyExportFileSystemState/740b82d7df1422bbeeb99ad284ae8706/cf/81b930bdf01041548cb303bda48ab875 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,741 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b. completed. 2023-07-14 11:14:35,742 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b. 2023-07-14 11:14:35,742 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:14:35,742 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:14:35,742 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,742 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 11:14:35,742 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,46581,1689333142353' in zk 2023-07-14 11:14:35,753 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706. completed. 2023-07-14 11:14:35,753 DEBUG [rs(jenkins-hbase9.apache.org,40207,1689333142617)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706. 2023-07-14 11:14:35,753 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:14:35,753 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:14:35,753 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,753 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-14 11:14:35,753 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase9.apache.org,40207,1689333142617' in zk 2023-07-14 11:14:35,820 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:35,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:35,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:35,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:35,822 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 11:14:35,822 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:35,822 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 11:14:35,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,826 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:35,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 11:14:35,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:35,828 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 11:14:35,888 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,888 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-14 11:14:35,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,888 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:35,888 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-14 11:14:35,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:35,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:35,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:35,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,46581,1689333142353': 2023-07-14 11:14:35,892 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46581,1689333142353' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-14 11:14:35,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:35,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:35,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:35,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:35,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:35,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:35,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:35,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase9.apache.org,40207,1689333142617': 2023-07-14 11:14:35,897 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,40207,1689333142617' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-14 11:14:35,897 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-14 11:14:35,897 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 11:14:35,897 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 11:14:35,897 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,897 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 11:14:35,982 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,982 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,983 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,983 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:35,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,983 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:35,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,983 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:35,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:35,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:35,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:35,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:35,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,984 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:35,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:35,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:35,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:35,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:35,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,986 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:35,987 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,987 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:35,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:35,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:35,990 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:35,990 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:35,991 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:35,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:35,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:36,073 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:36,073 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:36,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:36,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:36,073 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:36,073 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:36,073 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:36,073 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:36,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:36,073 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:36,073 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:36,073 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:36,074 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,074 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:36,074 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:36,074 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,074 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:36,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:36,073 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:36,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:36,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:36,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:36,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:36,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:36,074 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:36,076 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:36,078 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:36,078 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,078 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,110 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,128 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:36,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 11:14:36,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:36,129 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-14 11:14:36,145 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-14 11:14:36,145 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,146 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689333275523Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689333276073 (+550 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689333276074 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689333276088 (+14 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689333276102 (+14 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689333276145 (+43 ms) 2023-07-14 11:14:36,149 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-14 11:14:36,150 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 624 msec 2023-07-14 11:14:36,630 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:36,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-14 11:14:36,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 11:14:36,631 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333276631 2023-07-14 11:14:36,632 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36847, tgtDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333276631, rawTgtDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333276631, srcFsUri=hdfs://localhost:36847, srcDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4 2023-07-14 11:14:36,660 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36847, inputRoot=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4 2023-07-14 11:14:36,660 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1255955294_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333276631, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333276631/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,660 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36847, inputRoot=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4, snapshotDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-14 11:14:36,671 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333276631/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:36,841 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:36,841 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:36,842 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:36,843 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:36,843 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:36,843 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:36,844 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:36,935 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/hadoop-466470331669555901.jar 2023-07-14 11:14:36,935 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:36,935 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:36,936 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:36,936 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:36,936 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:36,936 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:36,937 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 11:14:36,937 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 11:14:36,938 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 11:14:36,938 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 11:14:36,938 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 11:14:36,939 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 11:14:36,939 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 11:14:36,939 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 11:14:36,940 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 11:14:36,940 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 11:14:36,940 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:14:36,941 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:14:36,941 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:14:36,941 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:14:36,941 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:14:36,942 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:14:36,942 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:14:37,585 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0005_000001 (auth:SIMPLE) 2023-07-14 11:14:37,784 WARN [Listener at jenkins-hbase9.apache.org/36907] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 11:14:37,787 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-14 11:14:38,286 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:14:38,286 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:14:38,588 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0006_000001 (auth:SIMPLE) 2023-07-14 11:14:38,756 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 11:14:44,763 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0006_000001 (auth:SIMPLE) 2023-07-14 11:14:47,438 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 11:14:47,439 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 11:14:47,447 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:47,447 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 11:14:47,448 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 11:14:47,448 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1095779325_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:47,449 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-14 11:14:47,449 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-14 11:14:47,449 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1095779325_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333276631/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333276631/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:47,450 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333276631/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-14 11:14:47,450 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333276631/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-14 11:14:47,457 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-14 11:14:47,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testEmptyExportFileSystemState 2023-07-14 11:14:47,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 11:14:47,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 11:14:47,472 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333287472"}]},"ts":"1689333287472"} 2023-07-14 11:14:47,476 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-14 11:14:47,569 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-14 11:14:47,571 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8c3c95a6ac7b8e5153b0f2de76e2474b, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=740b82d7df1422bbeeb99ad284ae8706, UNASSIGN}] 2023-07-14 11:14:47,578 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8c3c95a6ac7b8e5153b0f2de76e2474b, UNASSIGN 2023-07-14 11:14:47,578 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=740b82d7df1422bbeeb99ad284ae8706, UNASSIGN 2023-07-14 11:14:47,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 11:14:47,579 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=8c3c95a6ac7b8e5153b0f2de76e2474b, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:47,579 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=740b82d7df1422bbeeb99ad284ae8706, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:47,579 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689333287579"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333287579"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333287579"}]},"ts":"1689333287579"} 2023-07-14 11:14:47,579 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689333287579"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333287579"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333287579"}]},"ts":"1689333287579"} 2023-07-14 11:14:47,583 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 8c3c95a6ac7b8e5153b0f2de76e2474b, server=jenkins-hbase9.apache.org,46581,1689333142353}] 2023-07-14 11:14:47,584 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 740b82d7df1422bbeeb99ad284ae8706, server=jenkins-hbase9.apache.org,40207,1689333142617}] 2023-07-14 11:14:47,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 740b82d7df1422bbeeb99ad284ae8706 2023-07-14 11:14:47,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 740b82d7df1422bbeeb99ad284ae8706, disabling compactions & flushes 2023-07-14 11:14:47,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706. 2023-07-14 11:14:47,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706. 2023-07-14 11:14:47,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706. after waiting 0 ms 2023-07-14 11:14:47,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706. 2023-07-14 11:14:47,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 8c3c95a6ac7b8e5153b0f2de76e2474b 2023-07-14 11:14:47,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 8c3c95a6ac7b8e5153b0f2de76e2474b, disabling compactions & flushes 2023-07-14 11:14:47,736 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b. 2023-07-14 11:14:47,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b. 2023-07-14 11:14:47,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b. after waiting 0 ms 2023-07-14 11:14:47,736 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b. 2023-07-14 11:14:47,754 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testEmptyExportFileSystemState/8c3c95a6ac7b8e5153b0f2de76e2474b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 11:14:47,756 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:14:47,773 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b. 2023-07-14 11:14:47,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 8c3c95a6ac7b8e5153b0f2de76e2474b: 2023-07-14 11:14:47,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 8c3c95a6ac7b8e5153b0f2de76e2474b 2023-07-14 11:14:47,776 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=8c3c95a6ac7b8e5153b0f2de76e2474b, regionState=CLOSED 2023-07-14 11:14:47,776 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689333287776"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333287776"}]},"ts":"1689333287776"} 2023-07-14 11:14:47,780 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-14 11:14:47,780 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 8c3c95a6ac7b8e5153b0f2de76e2474b, server=jenkins-hbase9.apache.org,46581,1689333142353 in 197 msec 2023-07-14 11:14:47,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 11:14:47,782 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=8c3c95a6ac7b8e5153b0f2de76e2474b, UNASSIGN in 209 msec 2023-07-14 11:14:47,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testEmptyExportFileSystemState/740b82d7df1422bbeeb99ad284ae8706/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 11:14:47,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:14:47,788 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706. 2023-07-14 11:14:47,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 740b82d7df1422bbeeb99ad284ae8706: 2023-07-14 11:14:47,790 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 740b82d7df1422bbeeb99ad284ae8706 2023-07-14 11:14:47,790 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=740b82d7df1422bbeeb99ad284ae8706, regionState=CLOSED 2023-07-14 11:14:47,791 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689333287790"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333287790"}]},"ts":"1689333287790"} 2023-07-14 11:14:47,795 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-14 11:14:47,795 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 740b82d7df1422bbeeb99ad284ae8706, server=jenkins-hbase9.apache.org,40207,1689333142617 in 209 msec 2023-07-14 11:14:47,797 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-14 11:14:47,797 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=740b82d7df1422bbeeb99ad284ae8706, UNASSIGN in 224 msec 2023-07-14 11:14:47,798 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333287798"}]},"ts":"1689333287798"} 2023-07-14 11:14:47,806 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-14 11:14:47,965 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-14 11:14:47,977 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 509 msec 2023-07-14 11:14:48,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-14 11:14:48,083 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-14 11:14:48,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testEmptyExportFileSystemState 2023-07-14 11:14:48,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 11:14:48,089 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 11:14:48,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-14 11:14:48,091 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 11:14:48,092 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46581] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-14 11:14:48,106 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testEmptyExportFileSystemState/740b82d7df1422bbeeb99ad284ae8706 2023-07-14 11:14:48,108 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testEmptyExportFileSystemState/740b82d7df1422bbeeb99ad284ae8706/cf, FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testEmptyExportFileSystemState/740b82d7df1422bbeeb99ad284ae8706/recovered.edits] 2023-07-14 11:14:48,109 DEBUG [HFileArchiver-26] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testEmptyExportFileSystemState/8c3c95a6ac7b8e5153b0f2de76e2474b 2023-07-14 11:14:48,112 DEBUG [HFileArchiver-26] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testEmptyExportFileSystemState/8c3c95a6ac7b8e5153b0f2de76e2474b/cf, FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testEmptyExportFileSystemState/8c3c95a6ac7b8e5153b0f2de76e2474b/recovered.edits] 2023-07-14 11:14:48,115 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testEmptyExportFileSystemState/740b82d7df1422bbeeb99ad284ae8706/cf/81b930bdf01041548cb303bda48ab875 to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testEmptyExportFileSystemState/740b82d7df1422bbeeb99ad284ae8706/cf/81b930bdf01041548cb303bda48ab875 2023-07-14 11:14:48,118 DEBUG [HFileArchiver-26] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testEmptyExportFileSystemState/8c3c95a6ac7b8e5153b0f2de76e2474b/cf/3b5b8b67ca3e4d58bd4202fbbbcec00c to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testEmptyExportFileSystemState/8c3c95a6ac7b8e5153b0f2de76e2474b/cf/3b5b8b67ca3e4d58bd4202fbbbcec00c 2023-07-14 11:14:48,119 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testEmptyExportFileSystemState/740b82d7df1422bbeeb99ad284ae8706/recovered.edits/9.seqid to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testEmptyExportFileSystemState/740b82d7df1422bbeeb99ad284ae8706/recovered.edits/9.seqid 2023-07-14 11:14:48,120 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testEmptyExportFileSystemState/740b82d7df1422bbeeb99ad284ae8706 2023-07-14 11:14:48,123 DEBUG [HFileArchiver-26] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testEmptyExportFileSystemState/8c3c95a6ac7b8e5153b0f2de76e2474b/recovered.edits/9.seqid to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testEmptyExportFileSystemState/8c3c95a6ac7b8e5153b0f2de76e2474b/recovered.edits/9.seqid 2023-07-14 11:14:48,124 DEBUG [HFileArchiver-26] backup.HFileArchiver(596): Deleted hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testEmptyExportFileSystemState/8c3c95a6ac7b8e5153b0f2de76e2474b 2023-07-14 11:14:48,124 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-14 11:14:48,127 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 11:14:48,144 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-14 11:14:48,146 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-14 11:14:48,147 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 11:14:48,147 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-14 11:14:48,148 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689333288147"}]},"ts":"9223372036854775807"} 2023-07-14 11:14:48,148 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689333288147"}]},"ts":"9223372036854775807"} 2023-07-14 11:14:48,151 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 11:14:48,151 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8c3c95a6ac7b8e5153b0f2de76e2474b, NAME => 'testtb-testEmptyExportFileSystemState,,1689333274081.8c3c95a6ac7b8e5153b0f2de76e2474b.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 740b82d7df1422bbeeb99ad284ae8706, NAME => 'testtb-testEmptyExportFileSystemState,1,1689333274081.740b82d7df1422bbeeb99ad284ae8706.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 11:14:48,151 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-14 11:14:48,152 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689333288152"}]},"ts":"9223372036854775807"} 2023-07-14 11:14:48,153 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-14 11:14:48,351 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-14 11:14:48,353 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 267 msec 2023-07-14 11:14:48,488 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 11:14:48,488 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 11:14:48,488 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 11:14:48,488 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 11:14:48,489 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 11:14:48,489 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 11:14:48,489 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 11:14:48,490 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-14 11:14:48,574 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 11:14:48,574 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 11:14:48,574 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 11:14:48,574 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:48,574 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:48,574 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-14 11:14:48,574 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:48,574 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:48,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-14 11:14:48,576 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-14 11:14:48,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-14 11:14:48,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:48,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-14 11:14:48,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-14 11:14:48,627 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=765 (was 758) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1095779325_17 at /127.0.0.1:42242 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1095779325_17 at /127.0.0.1:53016 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-26 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49bc206a-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-24 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49bc206a-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-25 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1095779325_17 at /127.0.0.1:58702 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1128442538_1 at /127.0.0.1:42214 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x49bc206a-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4716 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x49bc206a-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (232395425) connection to jenkins-hbase9.apache.org/172.31.2.10:46415 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=900 (was 903), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1462 (was 1447) - SystemLoadAverage LEAK? -, ProcessCount=190 (was 192), AvailableMemoryMB=2521 (was 1092) - AvailableMemoryMB LEAK? - 2023-07-14 11:14:48,628 WARN [Listener at jenkins-hbase9.apache.org/36907] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-14 11:14:48,657 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=1462, ProcessCount=190, AvailableMemoryMB=2519 2023-07-14 11:14:48,657 WARN [Listener at jenkins-hbase9.apache.org/36907] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-07-14 11:14:48,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.HMaster$4(2112): Client=jenkins//172.31.2.10 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-14 11:14:48,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:48,662 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-14 11:14:48,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(700): Client=jenkins//172.31.2.10 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-14 11:14:48,663 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-14 11:14:48,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 11:14:48,666 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/feac04a3dcd83b15881e8b8e90b357c9 2023-07-14 11:14:48,666 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/54d18e8d94ce449449aa3cf2b01b462e 2023-07-14 11:14:48,667 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/feac04a3dcd83b15881e8b8e90b357c9 empty. 2023-07-14 11:14:48,667 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/54d18e8d94ce449449aa3cf2b01b462e empty. 2023-07-14 11:14:48,667 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/feac04a3dcd83b15881e8b8e90b357c9 2023-07-14 11:14:48,667 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/54d18e8d94ce449449aa3cf2b01b462e 2023-07-14 11:14:48,667 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-14 11:14:48,714 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-14 11:14:48,715 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => feac04a3dcd83b15881e8b8e90b357c9, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp 2023-07-14 11:14:48,718 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 54d18e8d94ce449449aa3cf2b01b462e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp 2023-07-14 11:14:48,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 11:14:48,792 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:48,792 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing feac04a3dcd83b15881e8b8e90b357c9, disabling compactions & flushes 2023-07-14 11:14:48,792 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9. 2023-07-14 11:14:48,792 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9. 2023-07-14 11:14:48,792 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9. after waiting 0 ms 2023-07-14 11:14:48,792 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9. 2023-07-14 11:14:48,793 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9. 2023-07-14 11:14:48,793 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for feac04a3dcd83b15881e8b8e90b357c9: 2023-07-14 11:14:48,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:48,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 54d18e8d94ce449449aa3cf2b01b462e, disabling compactions & flushes 2023-07-14 11:14:48,798 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e. 2023-07-14 11:14:48,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e. 2023-07-14 11:14:48,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e. after waiting 0 ms 2023-07-14 11:14:48,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e. 2023-07-14 11:14:48,798 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e. 2023-07-14 11:14:48,798 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 54d18e8d94ce449449aa3cf2b01b462e: 2023-07-14 11:14:48,801 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-14 11:14:48,802 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689333288802"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333288802"}]},"ts":"1689333288802"} 2023-07-14 11:14:48,802 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689333288802"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333288802"}]},"ts":"1689333288802"} 2023-07-14 11:14:48,805 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-14 11:14:48,806 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-14 11:14:48,806 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333288806"}]},"ts":"1689333288806"} 2023-07-14 11:14:48,807 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-14 11:14:48,811 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase9.apache.org=0} racks are {/default-rack=0} 2023-07-14 11:14:48,812 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-14 11:14:48,812 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-14 11:14:48,812 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-14 11:14:48,812 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-14 11:14:48,813 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=feac04a3dcd83b15881e8b8e90b357c9, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=54d18e8d94ce449449aa3cf2b01b462e, ASSIGN}] 2023-07-14 11:14:48,816 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=54d18e8d94ce449449aa3cf2b01b462e, ASSIGN 2023-07-14 11:14:48,816 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=feac04a3dcd83b15881e8b8e90b357c9, ASSIGN 2023-07-14 11:14:48,817 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=54d18e8d94ce449449aa3cf2b01b462e, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,35929,1689333142490; forceNewPlan=false, retain=false 2023-07-14 11:14:48,817 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=feac04a3dcd83b15881e8b8e90b357c9, ASSIGN; state=OFFLINE, location=jenkins-hbase9.apache.org,46581,1689333142353; forceNewPlan=false, retain=false 2023-07-14 11:14:48,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 11:14:48,968 INFO [jenkins-hbase9:38311] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-14 11:14:48,971 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=54d18e8d94ce449449aa3cf2b01b462e, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:48,971 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=feac04a3dcd83b15881e8b8e90b357c9, regionState=OPENING, regionLocation=jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:48,973 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689333288971"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333288971"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333288971"}]},"ts":"1689333288971"} 2023-07-14 11:14:48,973 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689333288971"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333288971"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333288971"}]},"ts":"1689333288971"} 2023-07-14 11:14:48,975 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure feac04a3dcd83b15881e8b8e90b357c9, server=jenkins-hbase9.apache.org,46581,1689333142353}] 2023-07-14 11:14:48,976 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 54d18e8d94ce449449aa3cf2b01b462e, server=jenkins-hbase9.apache.org,35929,1689333142490}] 2023-07-14 11:14:49,137 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9. 2023-07-14 11:14:49,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => feac04a3dcd83b15881e8b8e90b357c9, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9.', STARTKEY => '', ENDKEY => '1'} 2023-07-14 11:14:49,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9. service=AccessControlService 2023-07-14 11:14:49,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:14:49,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp feac04a3dcd83b15881e8b8e90b357c9 2023-07-14 11:14:49,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:49,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for feac04a3dcd83b15881e8b8e90b357c9 2023-07-14 11:14:49,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for feac04a3dcd83b15881e8b8e90b357c9 2023-07-14 11:14:49,148 INFO [StoreOpener-feac04a3dcd83b15881e8b8e90b357c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region feac04a3dcd83b15881e8b8e90b357c9 2023-07-14 11:14:49,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e. 2023-07-14 11:14:49,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 54d18e8d94ce449449aa3cf2b01b462e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e.', STARTKEY => '1', ENDKEY => ''} 2023-07-14 11:14:49,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e. service=AccessControlService 2023-07-14 11:14:49,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-14 11:14:49,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 54d18e8d94ce449449aa3cf2b01b462e 2023-07-14 11:14:49,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-14 11:14:49,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7894): checking encryption for 54d18e8d94ce449449aa3cf2b01b462e 2023-07-14 11:14:49,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(7897): checking classloading for 54d18e8d94ce449449aa3cf2b01b462e 2023-07-14 11:14:49,154 DEBUG [StoreOpener-feac04a3dcd83b15881e8b8e90b357c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithSkipTmp/feac04a3dcd83b15881e8b8e90b357c9/cf 2023-07-14 11:14:49,154 DEBUG [StoreOpener-feac04a3dcd83b15881e8b8e90b357c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithSkipTmp/feac04a3dcd83b15881e8b8e90b357c9/cf 2023-07-14 11:14:49,155 INFO [StoreOpener-feac04a3dcd83b15881e8b8e90b357c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region feac04a3dcd83b15881e8b8e90b357c9 columnFamilyName cf 2023-07-14 11:14:49,155 INFO [StoreOpener-54d18e8d94ce449449aa3cf2b01b462e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 54d18e8d94ce449449aa3cf2b01b462e 2023-07-14 11:14:49,155 INFO [StoreOpener-feac04a3dcd83b15881e8b8e90b357c9-1] regionserver.HStore(310): Store=feac04a3dcd83b15881e8b8e90b357c9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:14:49,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithSkipTmp/feac04a3dcd83b15881e8b8e90b357c9 2023-07-14 11:14:49,156 DEBUG [StoreOpener-54d18e8d94ce449449aa3cf2b01b462e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithSkipTmp/54d18e8d94ce449449aa3cf2b01b462e/cf 2023-07-14 11:14:49,156 DEBUG [StoreOpener-54d18e8d94ce449449aa3cf2b01b462e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithSkipTmp/54d18e8d94ce449449aa3cf2b01b462e/cf 2023-07-14 11:14:49,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithSkipTmp/feac04a3dcd83b15881e8b8e90b357c9 2023-07-14 11:14:49,157 INFO [StoreOpener-54d18e8d94ce449449aa3cf2b01b462e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 54d18e8d94ce449449aa3cf2b01b462e columnFamilyName cf 2023-07-14 11:14:49,158 INFO [StoreOpener-54d18e8d94ce449449aa3cf2b01b462e-1] regionserver.HStore(310): Store=54d18e8d94ce449449aa3cf2b01b462e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-14 11:14:49,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithSkipTmp/54d18e8d94ce449449aa3cf2b01b462e 2023-07-14 11:14:49,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithSkipTmp/54d18e8d94ce449449aa3cf2b01b462e 2023-07-14 11:14:49,160 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for feac04a3dcd83b15881e8b8e90b357c9 2023-07-14 11:14:49,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1055): writing seq id for 54d18e8d94ce449449aa3cf2b01b462e 2023-07-14 11:14:49,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithSkipTmp/feac04a3dcd83b15881e8b8e90b357c9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:14:49,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithSkipTmp/54d18e8d94ce449449aa3cf2b01b462e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-14 11:14:49,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened feac04a3dcd83b15881e8b8e90b357c9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61001054, jitterRate=-0.09101346135139465}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:14:49,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for feac04a3dcd83b15881e8b8e90b357c9: 2023-07-14 11:14:49,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1072): Opened 54d18e8d94ce449449aa3cf2b01b462e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58788701, jitterRate=-0.1239800900220871}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-14 11:14:49,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(965): Region open journal for 54d18e8d94ce449449aa3cf2b01b462e: 2023-07-14 11:14:49,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9., pid=108, masterSystemTime=1689333289134 2023-07-14 11:14:49,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e., pid=109, masterSystemTime=1689333289134 2023-07-14 11:14:49,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9. 2023-07-14 11:14:49,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9. 2023-07-14 11:14:49,190 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=feac04a3dcd83b15881e8b8e90b357c9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:49,191 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689333289190"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333289190"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333289190"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333289190"}]},"ts":"1689333289190"} 2023-07-14 11:14:49,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e. 2023-07-14 11:14:49,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase9:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e. 2023-07-14 11:14:49,192 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=54d18e8d94ce449449aa3cf2b01b462e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:49,192 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689333289192"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689333289192"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689333289192"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689333289192"}]},"ts":"1689333289192"} 2023-07-14 11:14:49,195 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=106 2023-07-14 11:14:49,195 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure feac04a3dcd83b15881e8b8e90b357c9, server=jenkins-hbase9.apache.org,46581,1689333142353 in 217 msec 2023-07-14 11:14:49,197 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=feac04a3dcd83b15881e8b8e90b357c9, ASSIGN in 382 msec 2023-07-14 11:14:49,198 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=107 2023-07-14 11:14:49,198 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 54d18e8d94ce449449aa3cf2b01b462e, server=jenkins-hbase9.apache.org,35929,1689333142490 in 220 msec 2023-07-14 11:14:49,201 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-14 11:14:49,201 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=54d18e8d94ce449449aa3cf2b01b462e, ASSIGN in 385 msec 2023-07-14 11:14:49,202 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-14 11:14:49,202 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333289202"}]},"ts":"1689333289202"} 2023-07-14 11:14:49,203 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-14 11:14:49,207 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-14 11:14:49,207 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-14 11:14:49,210 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46581] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 11:14:49,212 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:49,212 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:49,212 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:49,212 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:14:49,214 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,214 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,214 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,214 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,215 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:49,215 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:49,215 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:49,215 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-14 11:14:49,220 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 557 msec 2023-07-14 11:14:49,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-14 11:14:49,273 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-14 11:14:49,273 DEBUG [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-14 11:14:49,273 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:14:49,287 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-14 11:14:49,288 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:14:49,288 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-14 11:14:49,292 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 11:14:49,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689333289292 (current time:1689333289292). 2023-07-14 11:14:49,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 11:14:49,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(139): Connect 0x03a918a9 to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:14:49,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@777d622e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:14:49,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:49,351 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40246, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:49,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03a918a9 to 127.0.0.1:58300 2023-07-14 11:14:49,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:14:49,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(139): Connect 0x748ce2b2 to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:14:49,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3f2bd0da, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:14:49,362 DEBUG [hconnection-0x235bb903-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:49,365 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:49,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:49,372 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41422, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:49,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x748ce2b2 to 127.0.0.1:58300 2023-07-14 11:14:49,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:14:49,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 11:14:49,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 11:14:49,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 11:14:49,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 11:14:49,378 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 11:14:49,379 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689333889379 2023-07-14 11:14:49,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 11:14:49,379 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,380 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 11:14:49,380 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 11:14:49,381 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 11:14:49,382 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 11:14:49,383 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-14 11:14:49,384 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 11:14:49,385 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689333889385 2023-07-14 11:14:49,446 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,446 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-14 11:14:49,446 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:49,448 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-14 11:14:49,448 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-14 11:14:49,449 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,449 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,451 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:49,451 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:49,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:49,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:49,451 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:49,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,451 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:49,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:49,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:49,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:49,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:49,452 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,452 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:49,453 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:49,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,453 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:49,453 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 11:14:49,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 11:14:49,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,453 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,453 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 11:14:49,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 11:14:49,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,454 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 11:14:49,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-14 11:14:49,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,454 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 11:14:49,463 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,474 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 11:14:49,474 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:49,474 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,466 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,478 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 11:14:49,478 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 11:14:49,478 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:49,478 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 11:14:49,478 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:49,478 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 11:14:49,478 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35929,1689333142490' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 11:14:49,480 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:49,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 11:14:49,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:49,482 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 11:14:49,491 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:49,491 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 11:14:49,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:49,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:49,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:49,491 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 11:14:49,492 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 11:14:49,492 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46581,1689333142353' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 11:14:49,491 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 11:14:49,492 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40207,1689333142617' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 11:14:49,491 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:49,492 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:49,492 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:49,494 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:49,494 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,494 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,494 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:49,494 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:49,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:49,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:49,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:49,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35929,1689333142490' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 11:14:49,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f2315fc[Count = 1] remaining members to acquire global barrier 2023-07-14 11:14:49,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:49,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:49,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:49,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:49,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:49,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:49,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:49,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:49,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:49,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46581,1689333142353' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 11:14:49,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f2315fc[Count = 0] remaining members to acquire global barrier 2023-07-14 11:14:49,499 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-14 11:14:49,499 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,500 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,500 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,500 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,501 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 11:14:49,500 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,501 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:49,501 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 11:14:49,501 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 11:14:49,501 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,40207,1689333142617' in zk 2023-07-14 11:14:49,501 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:49,500 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 11:14:49,502 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:49,502 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 11:14:49,505 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:14:49,505 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:14:49,506 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9. 2023-07-14 11:14:49,506 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9. started... 2023-07-14 11:14:49,507 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 11:14:49,507 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:49,508 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 11:14:49,513 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:14:49,513 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:14:49,516 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e. 2023-07-14 11:14:49,520 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e. started... 2023-07-14 11:14:49,516 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for feac04a3dcd83b15881e8b8e90b357c9: 2023-07-14 11:14:49,523 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,524 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:14:49,524 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 11:14:49,524 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 54d18e8d94ce449449aa3cf2b01b462e: 2023-07-14 11:14:49,524 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,524 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:14:49,524 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-14 11:14:49,608 WARN [DataStreamer for file /user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp/region-manifest.feac04a3dcd83b15881e8b8e90b357c9] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-14 11:14:49,609 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9. completed. 2023-07-14 11:14:49,609 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9. 2023-07-14 11:14:49,609 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:14:49,609 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:14:49,609 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:49,609 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 11:14:49,609 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,46581,1689333142353' in zk 2023-07-14 11:14:49,611 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:49,611 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 11:14:49,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:49,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:49,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:49,611 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:49,612 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 11:14:49,612 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e. completed. 2023-07-14 11:14:49,613 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e. 2023-07-14 11:14:49,613 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:14:49,613 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:14:49,613 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:49,613 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 11:14:49,613 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,35929,1689333142490' in zk 2023-07-14 11:14:49,616 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 11:14:49,616 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:49,616 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 11:14:49,620 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:49,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:49,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:49,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:49,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:49,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:49,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:49,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:49,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:49,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:49,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,46581,1689333142353': 2023-07-14 11:14:49,630 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46581,1689333142353' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-14 11:14:49,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:49,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:49,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:49,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:49,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:49,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:49,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:49,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:49,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:49,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:49,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:49,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:49,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,35929,1689333142490': 2023-07-14 11:14:49,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35929,1689333142490' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-14 11:14:49,636 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-14 11:14:49,636 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 11:14:49,636 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 11:14:49,636 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,636 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 11:14:49,638 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,638 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,638 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,638 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,639 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,639 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:49,638 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:49,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:49,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:49,639 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:49,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,638 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:49,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:49,639 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:49,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:49,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:49,640 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:49,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:49,640 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:49,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:49,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,641 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:49,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:49,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:49,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:49,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:49,646 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:49,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:49,646 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:49,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,647 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:49,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:49,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:49,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:49,650 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:49,650 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,650 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:49,651 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:49,651 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:49,651 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:49,651 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:49,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:49,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:49,651 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:49,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:49,651 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:49,653 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:49,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:49,654 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:49,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:49,655 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:49,655 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:49,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:49,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:49,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:49,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:49,658 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:49,658 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,658 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:49,658 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,658 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:49,658 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:49,658 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,658 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,682 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:49,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 11:14:49,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:49,684 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-14 11:14:49,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,798 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-14 11:14:49,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,799 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:49,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689333289379Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689333289653 (+274 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689333289653Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689333289660 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689333289695 (+35 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689333289798 (+103 ms) 2023-07-14 11:14:49,802 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 11:14:49,803 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 422 msec 2023-07-14 11:14:49,984 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:49,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 11:14:49,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 11:14:50,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35929] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 11:14:50,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46581] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-14 11:14:50,025 DEBUG [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,025 DEBUG [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9. 2023-07-14 11:14:50,025 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-14 11:14:50,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1583): Client=jenkins//172.31.2.10 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 11:14:50,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689333290085 (current time:1689333290085). 2023-07-14 11:14:50,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-14 11:14:50,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(139): Connect 0x01cfb98e to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:14:50,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7f228b15, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:14:50,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:50,122 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40256, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:50,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x01cfb98e to 127.0.0.1:58300 2023-07-14 11:14:50,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:14:50,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(139): Connect 0x3b4146c2 to 127.0.0.1:58300 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-14 11:14:50,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@473e8bed, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-14 11:14:50,230 DEBUG [hconnection-0x2c2fda3c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:50,232 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:40258, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:50,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-14 11:14:50,241 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.2.10:41428, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-14 11:14:50,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b4146c2 to 127.0.0.1:58300 2023-07-14 11:14:50,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:14:50,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-14 11:14:50,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-14 11:14:50,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 11:14:50,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 11:14:50,247 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 11:14:50,248 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689333890248 2023-07-14 11:14:50,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-14 11:14:50,249 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,250 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-14 11:14:50,250 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-14 11:14:50,253 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-14 11:14:50,253 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 11:14:50,254 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-14 11:14:50,255 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 11:14:50,256 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689333890256 2023-07-14 11:14:50,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,274 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-14 11:14:50,274 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:50,275 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-14 11:14:50,275 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-14 11:14:50,276 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,276 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,280 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:50,280 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:50,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:50,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:50,280 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:50,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:50,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:50,280 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:50,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:50,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,281 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,281 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 11:14:50,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,281 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:50,281 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 11:14:50,281 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 11:14:50,281 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 11:14:50,282 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:50,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,283 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:50,283 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:50,283 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 11:14:50,283 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 11:14:50,283 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 11:14:50,284 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,35929,1689333142490' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 11:14:50,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,284 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:50,284 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-14 11:14:50,284 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,284 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 11:14:50,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-14 11:14:50,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,284 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-14 11:14:50,284 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:50,286 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 11:14:50,286 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,286 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 11:14:50,286 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,46581,1689333142353' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 11:14:50,286 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-14 11:14:50,286 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-14 11:14:50,287 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-14 11:14:50,287 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-14 11:14:50,287 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase9.apache.org,40207,1689333142617' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-14 11:14:50,288 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,288 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:50,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:50,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:50,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:50,288 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:50,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:50,289 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,289 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:50,289 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,289 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:50,289 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,289 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:50,290 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,290 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-14 11:14:50,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:50,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:50,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:50,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:50,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,35929,1689333142490' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 11:14:50,291 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39a9bfd4[Count = 1] remaining members to acquire global barrier 2023-07-14 11:14:50,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:50,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:50,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:50,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:50,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:50,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:50,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:50,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:50,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:50,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase9.apache.org,46581,1689333142353' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-14 11:14:50,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39a9bfd4[Count = 0] remaining members to acquire global barrier 2023-07-14 11:14:50,294 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-14 11:14:50,294 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,301 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,301 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,301 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,301 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 11:14:50,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,301 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 11:14:50,301 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:50,301 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:14:50,301 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:14:50,302 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e. 2023-07-14 11:14:50,301 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 11:14:50,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,302 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,40207,1689333142617' in zk 2023-07-14 11:14:50,302 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e. started... 2023-07-14 11:14:50,302 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-14 11:14:50,302 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:50,302 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-14 11:14:50,302 INFO [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 54d18e8d94ce449449aa3cf2b01b462e 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-14 11:14:50,302 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-14 11:14:50,302 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-14 11:14:50,302 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9. 2023-07-14 11:14:50,302 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9. started... 2023-07-14 11:14:50,303 INFO [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] regionserver.HRegion(2745): Flushing feac04a3dcd83b15881e8b8e90b357c9 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-14 11:14:50,303 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 11:14:50,303 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:50,303 DEBUG [member: 'jenkins-hbase9.apache.org,40207,1689333142617' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 11:14:50,322 INFO [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithSkipTmp/54d18e8d94ce449449aa3cf2b01b462e/.tmp/cf/11c650cd36a44f6d831c697ef6f8b427 2023-07-14 11:14:50,325 INFO [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithSkipTmp/feac04a3dcd83b15881e8b8e90b357c9/.tmp/cf/4da95778565240d8a71bacb0fad6e3c6 2023-07-14 11:14:50,328 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithSkipTmp/54d18e8d94ce449449aa3cf2b01b462e/.tmp/cf/11c650cd36a44f6d831c697ef6f8b427 as hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithSkipTmp/54d18e8d94ce449449aa3cf2b01b462e/cf/11c650cd36a44f6d831c697ef6f8b427 2023-07-14 11:14:50,330 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithSkipTmp/feac04a3dcd83b15881e8b8e90b357c9/.tmp/cf/4da95778565240d8a71bacb0fad6e3c6 as hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithSkipTmp/feac04a3dcd83b15881e8b8e90b357c9/cf/4da95778565240d8a71bacb0fad6e3c6 2023-07-14 11:14:50,333 INFO [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithSkipTmp/54d18e8d94ce449449aa3cf2b01b462e/cf/11c650cd36a44f6d831c697ef6f8b427, entries=47, sequenceid=6, filesize=8.0 K 2023-07-14 11:14:50,335 INFO [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithSkipTmp/feac04a3dcd83b15881e8b8e90b357c9/cf/4da95778565240d8a71bacb0fad6e3c6, entries=3, sequenceid=6, filesize=5.0 K 2023-07-14 11:14:50,336 INFO [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for feac04a3dcd83b15881e8b8e90b357c9 in 34ms, sequenceid=6, compaction requested=false 2023-07-14 11:14:50,336 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-14 11:14:50,336 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for feac04a3dcd83b15881e8b8e90b357c9: 2023-07-14 11:14:50,337 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,337 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:14:50,337 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithSkipTmp/feac04a3dcd83b15881e8b8e90b357c9/cf/4da95778565240d8a71bacb0fad6e3c6] hfiles 2023-07-14 11:14:50,337 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithSkipTmp/feac04a3dcd83b15881e8b8e90b357c9/cf/4da95778565240d8a71bacb0fad6e3c6 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,337 INFO [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 54d18e8d94ce449449aa3cf2b01b462e in 35ms, sequenceid=6, compaction requested=false 2023-07-14 11:14:50,339 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 54d18e8d94ce449449aa3cf2b01b462e: 2023-07-14 11:14:50,339 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,339 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-14 11:14:50,339 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithSkipTmp/54d18e8d94ce449449aa3cf2b01b462e/cf/11c650cd36a44f6d831c697ef6f8b427] hfiles 2023-07-14 11:14:50,339 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithSkipTmp/54d18e8d94ce449449aa3cf2b01b462e/cf/11c650cd36a44f6d831c697ef6f8b427 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,350 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:50,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 11:14:50,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-14 11:14:50,353 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e. completed. 2023-07-14 11:14:50,353 DEBUG [rs(jenkins-hbase9.apache.org,35929,1689333142490)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e. 2023-07-14 11:14:50,353 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:14:50,353 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:14:50,353 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:50,353 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 11:14:50,353 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,35929,1689333142490' in zk 2023-07-14 11:14:50,353 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9. completed. 2023-07-14 11:14:50,354 DEBUG [rs(jenkins-hbase9.apache.org,46581,1689333142353)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9. 2023-07-14 11:14:50,354 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-14 11:14:50,354 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-14 11:14:50,355 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-14 11:14:50,355 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:50,355 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-14 11:14:50,355 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase9.apache.org,46581,1689333142353' in zk 2023-07-14 11:14:50,357 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:50,357 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 11:14:50,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:50,357 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:50,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:50,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:50,357 DEBUG [member: 'jenkins-hbase9.apache.org,35929,1689333142490' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 11:14:50,358 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:50,358 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-14 11:14:50,358 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:50,359 DEBUG [member: 'jenkins-hbase9.apache.org,46581,1689333142353' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-14 11:14:50,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:50,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:50,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:50,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:50,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:50,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:50,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,35929,1689333142490': 2023-07-14 11:14:50,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,35929,1689333142490' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-14 11:14:50,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:50,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:50,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:50,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:50,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:50,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:50,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:50,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:50,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:50,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:50,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:50,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:50,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase9.apache.org,46581,1689333142353': 2023-07-14 11:14:50,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase9.apache.org,46581,1689333142353' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-14 11:14:50,367 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-14 11:14:50,367 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-14 11:14:50,367 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-14 11:14:50,367 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,367 INFO [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-14 11:14:50,369 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,369 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,370 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:50,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,370 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:50,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,370 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,370 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,370 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:50,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:50,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-14 11:14:50,370 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:50,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-14 11:14:50,370 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:50,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:50,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:50,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:50,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:50,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-14 11:14:50,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,371 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:50,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,372 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:50,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-14 11:14:50,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:50,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:50,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:50,373 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:50,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-14 11:14:50,373 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:50,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,374 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:50,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:50,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:50,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:50,376 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:50,376 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,376 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:50,376 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:50,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:50,376 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:50,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:50,376 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:50,376 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:50,377 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,377 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,377 DEBUG [(jenkins-hbase9.apache.org,38311,1689333140751)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-14 11:14:50,377 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:50,377 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:50,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:50,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:50,378 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-14 11:14:50,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:50,377 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,377 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:14:50,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-14 11:14:50,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-14 11:14:50,378 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-14 11:14:50,379 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,379 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:14:50,379 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:14:50,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:50,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-14 11:14:50,379 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:50,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-14 11:14:50,379 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,379 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,418 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,461 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-14 11:14:50,461 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,462 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,462 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase9:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689333290249Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689333290377 (+128 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689333290379 (+2 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689333290382 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689333290407 (+25 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689333290461 (+54 ms) 2023-07-14 11:14:50,465 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-14 11:14:50,467 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 215 msec 2023-07-14 11:14:50,555 DEBUG [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-14 11:14:50,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-14 11:14:50,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-14 11:14:50,557 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333290557 2023-07-14 11:14:50,557 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36847, tgtDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333290557, rawTgtDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333290557, srcFsUri=hdfs://localhost:36847, srcDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4 2023-07-14 11:14:50,590 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36847, inputRoot=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4 2023-07-14 11:14:50,590 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-511801653_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333290557, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333290557/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,590 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36847, inputRoot=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4, snapshotDir=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-14 11:14:50,610 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333290557/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:14:50,634 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:50,634 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:50,635 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:50,635 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:50,635 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:50,636 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:50,636 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:50,713 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/hadoop-1698955713978257090.jar 2023-07-14 11:14:50,714 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:50,714 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:50,715 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:50,715 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:50,716 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:50,716 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-14 11:14:50,716 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-14 11:14:50,717 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-14 11:14:50,718 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-14 11:14:50,718 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-14 11:14:50,719 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-14 11:14:50,719 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-14 11:14:50,720 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-14 11:14:50,720 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-14 11:14:50,720 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-14 11:14:50,721 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-14 11:14:50,722 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:14:50,722 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:14:50,722 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:14:50,723 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:14:50,723 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-14 11:14:50,723 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:14:50,724 DEBUG [Listener at jenkins-hbase9.apache.org/36907] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-14 11:14:52,235 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0006_000001 (auth:SIMPLE) 2023-07-14 11:14:52,418 WARN [Listener at jenkins-hbase9.apache.org/36907] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-14 11:14:52,423 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-14 11:14:52,424 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-14 11:14:52,536 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:14:52,536 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-14 11:14:53,137 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0007_000001 (auth:SIMPLE) 2023-07-14 11:14:53,354 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 11:15:00,787 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0007_000001 (auth:SIMPLE) 2023-07-14 11:15:03,272 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0007_000001 (auth:SIMPLE) 2023-07-14 11:15:07,590 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0007_000001 (auth:SIMPLE) 2023-07-14 11:15:08,719 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-14 11:15:08,719 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-14 11:15:08,744 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:08,744 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-14 11:15:08,745 INFO [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-14 11:15:08,745 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1095779325_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:08,746 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-14 11:15:08,746 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-14 11:15:08,746 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1095779325_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333290557/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333290557/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:08,747 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333290557/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-14 11:15:08,747 DEBUG [Listener at jenkins-hbase9.apache.org/36907] snapshot.TestExportSnapshot(367): hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/export-test/export-1689333290557/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-14 11:15:08,754 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:08,754 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.HMaster$11(2418): Client=jenkins//172.31.2.10 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:08,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:08,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 11:15:08,762 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333308762"}]},"ts":"1689333308762"} 2023-07-14 11:15:08,764 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-14 11:15:08,768 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-14 11:15:08,769 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=feac04a3dcd83b15881e8b8e90b357c9, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=54d18e8d94ce449449aa3cf2b01b462e, UNASSIGN}] 2023-07-14 11:15:08,770 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=54d18e8d94ce449449aa3cf2b01b462e, UNASSIGN 2023-07-14 11:15:08,772 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=feac04a3dcd83b15881e8b8e90b357c9, UNASSIGN 2023-07-14 11:15:08,772 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=54d18e8d94ce449449aa3cf2b01b462e, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:15:08,773 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689333308772"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333308772"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333308772"}]},"ts":"1689333308772"} 2023-07-14 11:15:08,773 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=feac04a3dcd83b15881e8b8e90b357c9, regionState=CLOSING, regionLocation=jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:15:08,773 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689333308773"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689333308773"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689333308773"}]},"ts":"1689333308773"} 2023-07-14 11:15:08,774 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 54d18e8d94ce449449aa3cf2b01b462e, server=jenkins-hbase9.apache.org,35929,1689333142490}] 2023-07-14 11:15:08,775 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure feac04a3dcd83b15881e8b8e90b357c9, server=jenkins-hbase9.apache.org,46581,1689333142353}] 2023-07-14 11:15:08,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 11:15:08,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close 54d18e8d94ce449449aa3cf2b01b462e 2023-07-14 11:15:08,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 54d18e8d94ce449449aa3cf2b01b462e, disabling compactions & flushes 2023-07-14 11:15:08,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e. 2023-07-14 11:15:08,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e. 2023-07-14 11:15:08,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e. after waiting 0 ms 2023-07-14 11:15:08,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e. 2023-07-14 11:15:08,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(111): Close feac04a3dcd83b15881e8b8e90b357c9 2023-07-14 11:15:08,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing feac04a3dcd83b15881e8b8e90b357c9, disabling compactions & flushes 2023-07-14 11:15:08,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9. 2023-07-14 11:15:08,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9. 2023-07-14 11:15:08,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9. after waiting 0 ms 2023-07-14 11:15:08,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9. 2023-07-14 11:15:08,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithSkipTmp/54d18e8d94ce449449aa3cf2b01b462e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 11:15:08,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:15:08,959 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e. 2023-07-14 11:15:08,959 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 54d18e8d94ce449449aa3cf2b01b462e: 2023-07-14 11:15:08,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/default/testtb-testExportFileSystemStateWithSkipTmp/feac04a3dcd83b15881e8b8e90b357c9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 11:15:08,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:15:08,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9. 2023-07-14 11:15:08,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for feac04a3dcd83b15881e8b8e90b357c9: 2023-07-14 11:15:08,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed 54d18e8d94ce449449aa3cf2b01b462e 2023-07-14 11:15:08,963 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=54d18e8d94ce449449aa3cf2b01b462e, regionState=CLOSED 2023-07-14 11:15:08,963 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689333308963"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333308963"}]},"ts":"1689333308963"} 2023-07-14 11:15:08,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.UnassignRegionHandler(149): Closed feac04a3dcd83b15881e8b8e90b357c9 2023-07-14 11:15:08,965 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=feac04a3dcd83b15881e8b8e90b357c9, regionState=CLOSED 2023-07-14 11:15:08,965 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689333308965"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689333308965"}]},"ts":"1689333308965"} 2023-07-14 11:15:08,969 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-14 11:15:08,969 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 54d18e8d94ce449449aa3cf2b01b462e, server=jenkins-hbase9.apache.org,35929,1689333142490 in 192 msec 2023-07-14 11:15:08,970 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-14 11:15:08,970 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=54d18e8d94ce449449aa3cf2b01b462e, UNASSIGN in 200 msec 2023-07-14 11:15:08,970 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure feac04a3dcd83b15881e8b8e90b357c9, server=jenkins-hbase9.apache.org,46581,1689333142353 in 193 msec 2023-07-14 11:15:08,972 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=115, resume processing ppid=114 2023-07-14 11:15:08,972 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=feac04a3dcd83b15881e8b8e90b357c9, UNASSIGN in 201 msec 2023-07-14 11:15:08,973 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689333308972"}]},"ts":"1689333308972"} 2023-07-14 11:15:08,974 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-14 11:15:08,975 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-14 11:15:08,978 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 222 msec 2023-07-14 11:15:09,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-14 11:15:09,062 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-14 11:15:09,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.HMaster$5(2228): Client=jenkins//172.31.2.10 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:09,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:09,068 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:09,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:09,070 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:09,071 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46581] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:09,075 DEBUG [HFileArchiver-27] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/feac04a3dcd83b15881e8b8e90b357c9 2023-07-14 11:15:09,075 DEBUG [HFileArchiver-28] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/54d18e8d94ce449449aa3cf2b01b462e 2023-07-14 11:15:09,075 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:09,075 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:09,075 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:09,076 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 11:15:09,076 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:09,076 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-14 11:15:09,077 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:09,077 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:09,077 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:15:09,077 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-14 11:15:09,077 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 11:15:09,077 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:15:09,077 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data null 2023-07-14 11:15:09,077 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-14 11:15:09,077 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:15:09,077 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-14 11:15:09,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-14 11:15:09,078 DEBUG [HFileArchiver-28] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/54d18e8d94ce449449aa3cf2b01b462e/cf, FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/54d18e8d94ce449449aa3cf2b01b462e/recovered.edits] 2023-07-14 11:15:09,079 DEBUG [HFileArchiver-27] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/feac04a3dcd83b15881e8b8e90b357c9/cf, FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/feac04a3dcd83b15881e8b8e90b357c9/recovered.edits] 2023-07-14 11:15:09,085 DEBUG [HFileArchiver-28] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/54d18e8d94ce449449aa3cf2b01b462e/cf/11c650cd36a44f6d831c697ef6f8b427 to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/54d18e8d94ce449449aa3cf2b01b462e/cf/11c650cd36a44f6d831c697ef6f8b427 2023-07-14 11:15:09,086 DEBUG [HFileArchiver-27] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/feac04a3dcd83b15881e8b8e90b357c9/cf/4da95778565240d8a71bacb0fad6e3c6 to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/feac04a3dcd83b15881e8b8e90b357c9/cf/4da95778565240d8a71bacb0fad6e3c6 2023-07-14 11:15:09,088 DEBUG [HFileArchiver-28] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/54d18e8d94ce449449aa3cf2b01b462e/recovered.edits/9.seqid to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/54d18e8d94ce449449aa3cf2b01b462e/recovered.edits/9.seqid 2023-07-14 11:15:09,090 DEBUG [HFileArchiver-27] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/feac04a3dcd83b15881e8b8e90b357c9/recovered.edits/9.seqid to hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/feac04a3dcd83b15881e8b8e90b357c9/recovered.edits/9.seqid 2023-07-14 11:15:09,091 DEBUG [HFileArchiver-27] backup.HFileArchiver(596): Deleted hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/feac04a3dcd83b15881e8b8e90b357c9 2023-07-14 11:15:09,093 DEBUG [HFileArchiver-28] backup.HFileArchiver(596): Deleted hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/54d18e8d94ce449449aa3cf2b01b462e 2023-07-14 11:15:09,093 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-14 11:15:09,097 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:09,103 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-14 11:15:09,106 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-14 11:15:09,107 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:09,107 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-14 11:15:09,107 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689333309107"}]},"ts":"9223372036854775807"} 2023-07-14 11:15:09,107 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689333309107"}]},"ts":"9223372036854775807"} 2023-07-14 11:15:09,109 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-14 11:15:09,109 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => feac04a3dcd83b15881e8b8e90b357c9, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689333288659.feac04a3dcd83b15881e8b8e90b357c9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 54d18e8d94ce449449aa3cf2b01b462e, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689333288659.54d18e8d94ce449449aa3cf2b01b462e.', STARTKEY => '1', ENDKEY => ''}] 2023-07-14 11:15:09,109 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-14 11:15:09,109 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689333309109"}]},"ts":"9223372036854775807"} 2023-07-14 11:15:09,111 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-14 11:15:09,114 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:09,115 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 51 msec 2023-07-14 11:15:09,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-14 11:15:09,180 INFO [Listener at jenkins-hbase9.apache.org/36907] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-14 11:15:09,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-14 11:15:09,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:09,206 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] master.MasterRpcServices(751): Client=jenkins//172.31.2.10 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-14 11:15:09,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38311] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-14 11:15:09,260 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=763 (was 765), OpenFileDescriptor=900 (was 900), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=1426 (was 1462), ProcessCount=190 (was 190), AvailableMemoryMB=1617 (was 2519) 2023-07-14 11:15:09,260 WARN [Listener at jenkins-hbase9.apache.org/36907] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-14 11:15:09,260 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-14 11:15:09,275 INFO [Listener at jenkins-hbase9.apache.org/36907] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 11:15:13,780 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689333153272_0007_000001 (auth:SIMPLE) 2023-07-14 11:15:14,569 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-14 11:15:23,415 INFO [Listener at jenkins-hbase9.apache.org/36907] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 11:15:37,437 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 11:15:37,438 INFO [Listener at jenkins-hbase9.apache.org/36907] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 11:15:37,555 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-14 11:15:37,567 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-14 11:15:37,568 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 11:15:37,587 INFO [Listener at jenkins-hbase9.apache.org/36907] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase9.apache.org:0 2023-07-14 11:15:37,595 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-14 11:15:37,595 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-14 11:15:37,595 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-14 11:15:37,595 INFO [Listener at jenkins-hbase9.apache.org/36907] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-14 11:15:37,595 DEBUG [Listener at jenkins-hbase9.apache.org/36907] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f9eca1b to 127.0.0.1:58300 2023-07-14 11:15:37,595 DEBUG [Listener at jenkins-hbase9.apache.org/36907] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:15:37,595 DEBUG [Listener at jenkins-hbase9.apache.org/36907] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-14 11:15:37,595 DEBUG [Listener at jenkins-hbase9.apache.org/36907] util.JVMClusterUtil(257): Found active master hash=875714014, stopped=false 2023-07-14 11:15:37,596 DEBUG [Listener at jenkins-hbase9.apache.org/36907] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:15:37,596 DEBUG [Listener at jenkins-hbase9.apache.org/36907] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-14 11:15:37,596 INFO [Listener at jenkins-hbase9.apache.org/36907] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase9.apache.org,38311,1689333140751 2023-07-14 11:15:37,598 INFO [Listener at jenkins-hbase9.apache.org/36907] procedure2.ProcedureExecutor(629): Stopping 2023-07-14 11:15:37,598 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 11:15:37,598 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 11:15:37,598 DEBUG [Listener at jenkins-hbase9.apache.org/36907] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x123ac060 to 127.0.0.1:58300 2023-07-14 11:15:37,598 DEBUG [Listener at jenkins-hbase9.apache.org/36907] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:15:37,598 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 11:15:37,598 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 11:15:37,599 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-14 11:15:37,599 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 11:15:37,599 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 11:15:37,600 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 11:15:37,600 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-14 11:15:37,598 INFO [Listener at jenkins-hbase9.apache.org/36907] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,46581,1689333142353' ***** 2023-07-14 11:15:37,600 DEBUG [Listener at jenkins-hbase9.apache.org/36907] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:15:37,600 INFO [Listener at jenkins-hbase9.apache.org/36907] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 11:15:37,600 INFO [Listener at jenkins-hbase9.apache.org/36907] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,35929,1689333142490' ***** 2023-07-14 11:15:37,600 DEBUG [Listener at jenkins-hbase9.apache.org/36907] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:15:37,600 INFO [Listener at jenkins-hbase9.apache.org/36907] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 11:15:37,600 INFO [Listener at jenkins-hbase9.apache.org/36907] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,40207,1689333142617' ***** 2023-07-14 11:15:37,600 DEBUG [Listener at jenkins-hbase9.apache.org/36907] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:15:37,600 INFO [Listener at jenkins-hbase9.apache.org/36907] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-14 11:15:37,600 INFO [RS:1;jenkins-hbase9:35929] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 11:15:37,601 INFO [RS:1;jenkins-hbase9:35929] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 11:15:37,601 INFO [RS:0;jenkins-hbase9:46581] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 11:15:37,601 INFO [RS:1;jenkins-hbase9:35929] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 11:15:37,601 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 11:15:37,601 INFO [RS:1;jenkins-hbase9:35929] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:15:37,601 INFO [RS:0;jenkins-hbase9:46581] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 11:15:37,601 INFO [RS:0;jenkins-hbase9:46581] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 11:15:37,601 INFO [RS:2;jenkins-hbase9:40207] regionserver.HeapMemoryManager(220): Stopping 2023-07-14 11:15:37,601 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 11:15:37,601 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-14 11:15:37,601 INFO [RS:2;jenkins-hbase9:40207] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-14 11:15:37,601 INFO [RS:0;jenkins-hbase9:46581] regionserver.HRegionServer(3305): Received CLOSE for 5065a3a7344a0e87bfc581aedd76c2e3 2023-07-14 11:15:37,601 DEBUG [RS:1;jenkins-hbase9:35929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x730956d2 to 127.0.0.1:58300 2023-07-14 11:15:37,602 DEBUG [RS:1;jenkins-hbase9:35929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:15:37,602 INFO [RS:2;jenkins-hbase9:40207] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-14 11:15:37,602 INFO [RS:2;jenkins-hbase9:40207] regionserver.HRegionServer(3305): Received CLOSE for e0c5a0ab4e8c0f43291fc116d0cd5122 2023-07-14 11:15:37,602 INFO [RS:0;jenkins-hbase9:46581] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:15:37,602 DEBUG [RS:0;jenkins-hbase9:46581] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x141da82b to 127.0.0.1:58300 2023-07-14 11:15:37,602 DEBUG [RS:0;jenkins-hbase9:46581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:15:37,602 INFO [RS:2;jenkins-hbase9:40207] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:15:37,602 DEBUG [RS:2;jenkins-hbase9:40207] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7a7017fe to 127.0.0.1:58300 2023-07-14 11:15:37,602 DEBUG [RS:2;jenkins-hbase9:40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:15:37,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 5065a3a7344a0e87bfc581aedd76c2e3, disabling compactions & flushes 2023-07-14 11:15:37,612 INFO [RS:0;jenkins-hbase9:46581] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-14 11:15:37,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing e0c5a0ab4e8c0f43291fc116d0cd5122, disabling compactions & flushes 2023-07-14 11:15:37,612 DEBUG [RS:0;jenkins-hbase9:46581] regionserver.HRegionServer(1478): Online Regions={5065a3a7344a0e87bfc581aedd76c2e3=hbase:acl,,1689333147434.5065a3a7344a0e87bfc581aedd76c2e3.} 2023-07-14 11:15:37,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689333146449.e0c5a0ab4e8c0f43291fc116d0cd5122. 2023-07-14 11:15:37,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689333147434.5065a3a7344a0e87bfc581aedd76c2e3. 2023-07-14 11:15:37,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689333147434.5065a3a7344a0e87bfc581aedd76c2e3. 2023-07-14 11:15:37,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689333146449.e0c5a0ab4e8c0f43291fc116d0cd5122. 2023-07-14 11:15:37,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689333147434.5065a3a7344a0e87bfc581aedd76c2e3. after waiting 0 ms 2023-07-14 11:15:37,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689333146449.e0c5a0ab4e8c0f43291fc116d0cd5122. after waiting 0 ms 2023-07-14 11:15:37,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689333147434.5065a3a7344a0e87bfc581aedd76c2e3. 2023-07-14 11:15:37,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689333146449.e0c5a0ab4e8c0f43291fc116d0cd5122. 2023-07-14 11:15:37,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing e0c5a0ab4e8c0f43291fc116d0cd5122 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-14 11:15:37,612 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 5065a3a7344a0e87bfc581aedd76c2e3 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-14 11:15:37,613 DEBUG [RS:0;jenkins-hbase9:46581] regionserver.HRegionServer(1504): Waiting on 5065a3a7344a0e87bfc581aedd76c2e3 2023-07-14 11:15:37,613 INFO [RS:1;jenkins-hbase9:35929] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,35929,1689333142490; all regions closed. 2023-07-14 11:15:37,613 INFO [RS:2;jenkins-hbase9:40207] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 11:15:37,614 INFO [RS:2;jenkins-hbase9:40207] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 11:15:37,614 INFO [RS:2;jenkins-hbase9:40207] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 11:15:37,614 INFO [RS:2;jenkins-hbase9:40207] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-14 11:15:37,614 INFO [RS:2;jenkins-hbase9:40207] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-14 11:15:37,614 DEBUG [RS:2;jenkins-hbase9:40207] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, e0c5a0ab4e8c0f43291fc116d0cd5122=hbase:namespace,,1689333146449.e0c5a0ab4e8c0f43291fc116d0cd5122.} 2023-07-14 11:15:37,614 DEBUG [RS:2;jenkins-hbase9:40207] regionserver.HRegionServer(1504): Waiting on 1588230740, e0c5a0ab4e8c0f43291fc116d0cd5122 2023-07-14 11:15:37,615 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-14 11:15:37,615 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-14 11:15:37,615 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-14 11:15:37,615 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-14 11:15:37,615 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-14 11:15:37,615 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-14 11:15:37,632 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 11:15:37,635 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 11:15:37,668 DEBUG [RS:1;jenkins-hbase9:35929] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/oldWALs 2023-07-14 11:15:37,668 INFO [RS:1;jenkins-hbase9:35929] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C35929%2C1689333142490:(num 1689333145633) 2023-07-14 11:15:37,668 DEBUG [RS:1;jenkins-hbase9:35929] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:15:37,668 INFO [RS:1;jenkins-hbase9:35929] regionserver.LeaseManager(133): Closed leases 2023-07-14 11:15:37,674 INFO [RS:1;jenkins-hbase9:35929] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-14 11:15:37,675 INFO [RS:1;jenkins-hbase9:35929] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 11:15:37,675 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 11:15:37,675 INFO [RS:1;jenkins-hbase9:35929] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 11:15:37,675 INFO [RS:1;jenkins-hbase9:35929] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 11:15:37,682 INFO [regionserver/jenkins-hbase9:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-14 11:15:37,736 INFO [RS:1;jenkins-hbase9:35929] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:35929 2023-07-14 11:15:37,744 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/namespace/e0c5a0ab4e8c0f43291fc116d0cd5122/.tmp/info/acaf3436c3ff43debb3a1817b7d8a1f0 2023-07-14 11:15:37,748 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:15:37,749 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 11:15:37,749 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:15:37,749 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,35929,1689333142490 2023-07-14 11:15:37,749 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 11:15:37,749 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 11:15:37,749 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 11:15:37,755 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,35929,1689333142490] 2023-07-14 11:15:37,756 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,35929,1689333142490; numProcessing=1 2023-07-14 11:15:37,758 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,35929,1689333142490 already deleted, retry=false 2023-07-14 11:15:37,758 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,35929,1689333142490 expired; onlineServers=2 2023-07-14 11:15:37,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/acl/5065a3a7344a0e87bfc581aedd76c2e3/.tmp/l/ffe3cd02a2a64e42abfdd293d50eb26c 2023-07-14 11:15:37,761 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/namespace/e0c5a0ab4e8c0f43291fc116d0cd5122/.tmp/info/acaf3436c3ff43debb3a1817b7d8a1f0 as hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/namespace/e0c5a0ab4e8c0f43291fc116d0cd5122/info/acaf3436c3ff43debb3a1817b7d8a1f0 2023-07-14 11:15:37,764 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740/.tmp/info/dbdfe74ca4fa4b44bf27e175a43b5195 2023-07-14 11:15:37,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ffe3cd02a2a64e42abfdd293d50eb26c 2023-07-14 11:15:37,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/acl/5065a3a7344a0e87bfc581aedd76c2e3/.tmp/l/ffe3cd02a2a64e42abfdd293d50eb26c as hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/acl/5065a3a7344a0e87bfc581aedd76c2e3/l/ffe3cd02a2a64e42abfdd293d50eb26c 2023-07-14 11:15:37,772 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dbdfe74ca4fa4b44bf27e175a43b5195 2023-07-14 11:15:37,773 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/namespace/e0c5a0ab4e8c0f43291fc116d0cd5122/info/acaf3436c3ff43debb3a1817b7d8a1f0, entries=2, sequenceid=6, filesize=4.8 K 2023-07-14 11:15:37,774 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e0c5a0ab4e8c0f43291fc116d0cd5122 in 162ms, sequenceid=6, compaction requested=false 2023-07-14 11:15:37,775 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ffe3cd02a2a64e42abfdd293d50eb26c 2023-07-14 11:15:37,775 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/acl/5065a3a7344a0e87bfc581aedd76c2e3/l/ffe3cd02a2a64e42abfdd293d50eb26c, entries=7, sequenceid=18, filesize=5.2 K 2023-07-14 11:15:37,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 5065a3a7344a0e87bfc581aedd76c2e3 in 164ms, sequenceid=18, compaction requested=false 2023-07-14 11:15:37,822 DEBUG [RS:2;jenkins-hbase9:40207] regionserver.HRegionServer(1504): Waiting on 1588230740, e0c5a0ab4e8c0f43291fc116d0cd5122 2023-07-14 11:15:37,823 DEBUG [RS:0;jenkins-hbase9:46581] regionserver.HRegionServer(1504): Waiting on 5065a3a7344a0e87bfc581aedd76c2e3 2023-07-14 11:15:37,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/acl/5065a3a7344a0e87bfc581aedd76c2e3/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-14 11:15:37,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/namespace/e0c5a0ab4e8c0f43291fc116d0cd5122/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-14 11:15:37,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:15:37,852 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:15:37,853 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689333147434.5065a3a7344a0e87bfc581aedd76c2e3. 2023-07-14 11:15:37,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689333146449.e0c5a0ab4e8c0f43291fc116d0cd5122. 2023-07-14 11:15:37,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 5065a3a7344a0e87bfc581aedd76c2e3: 2023-07-14 11:15:37,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for e0c5a0ab4e8c0f43291fc116d0cd5122: 2023-07-14 11:15:37,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689333147434.5065a3a7344a0e87bfc581aedd76c2e3. 2023-07-14 11:15:37,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689333146449.e0c5a0ab4e8c0f43291fc116d0cd5122. 2023-07-14 11:15:37,858 INFO [RS:1;jenkins-hbase9:35929] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,35929,1689333142490; zookeeper connection closed. 2023-07-14 11:15:37,858 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 11:15:37,858 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:35929-0x101637acd0d0002, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 11:15:37,868 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740/.tmp/rep_barrier/9fa43fbbb2c943c0837c65a9a96263dc 2023-07-14 11:15:37,868 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@15ee1326] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@15ee1326 2023-07-14 11:15:37,874 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9fa43fbbb2c943c0837c65a9a96263dc 2023-07-14 11:15:37,952 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740/.tmp/table/7107e8196608451aa6646c096cf9f0e6 2023-07-14 11:15:37,966 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7107e8196608451aa6646c096cf9f0e6 2023-07-14 11:15:37,969 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740/.tmp/info/dbdfe74ca4fa4b44bf27e175a43b5195 as hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740/info/dbdfe74ca4fa4b44bf27e175a43b5195 2023-07-14 11:15:37,981 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dbdfe74ca4fa4b44bf27e175a43b5195 2023-07-14 11:15:37,981 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740/info/dbdfe74ca4fa4b44bf27e175a43b5195, entries=48, sequenceid=131, filesize=10.3 K 2023-07-14 11:15:37,983 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740/.tmp/rep_barrier/9fa43fbbb2c943c0837c65a9a96263dc as hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740/rep_barrier/9fa43fbbb2c943c0837c65a9a96263dc 2023-07-14 11:15:37,989 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9fa43fbbb2c943c0837c65a9a96263dc 2023-07-14 11:15:37,989 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740/rep_barrier/9fa43fbbb2c943c0837c65a9a96263dc, entries=13, sequenceid=131, filesize=6.4 K 2023-07-14 11:15:37,990 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740/.tmp/table/7107e8196608451aa6646c096cf9f0e6 as hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740/table/7107e8196608451aa6646c096cf9f0e6 2023-07-14 11:15:38,005 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7107e8196608451aa6646c096cf9f0e6 2023-07-14 11:15:38,006 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HStore(1080): Added hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740/table/7107e8196608451aa6646c096cf9f0e6, entries=24, sequenceid=131, filesize=6.9 K 2023-07-14 11:15:38,007 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 392ms, sequenceid=131, compaction requested=false 2023-07-14 11:15:38,024 DEBUG [RS:2;jenkins-hbase9:40207] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-14 11:15:38,024 INFO [RS:0;jenkins-hbase9:46581] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,46581,1689333142353; all regions closed. 2023-07-14 11:15:38,083 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-14 11:15:38,089 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-14 11:15:38,089 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-14 11:15:38,092 DEBUG [RS:0;jenkins-hbase9:46581] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/oldWALs 2023-07-14 11:15:38,092 INFO [RS:0;jenkins-hbase9:46581] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C46581%2C1689333142353:(num 1689333145575) 2023-07-14 11:15:38,092 DEBUG [RS:0;jenkins-hbase9:46581] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:15:38,092 INFO [RS:0;jenkins-hbase9:46581] regionserver.LeaseManager(133): Closed leases 2023-07-14 11:15:38,093 INFO [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-14 11:15:38,093 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-14 11:15:38,093 INFO [RS:0;jenkins-hbase9:46581] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-14 11:15:38,093 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase9:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-14 11:15:38,095 INFO [RS:0;jenkins-hbase9:46581] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-14 11:15:38,095 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 11:15:38,096 INFO [RS:0;jenkins-hbase9:46581] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-14 11:15:38,096 INFO [RS:0;jenkins-hbase9:46581] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-14 11:15:38,097 INFO [RS:0;jenkins-hbase9:46581] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:46581 2023-07-14 11:15:38,098 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:15:38,098 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,46581,1689333142353 2023-07-14 11:15:38,098 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 11:15:38,100 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,46581,1689333142353] 2023-07-14 11:15:38,100 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,46581,1689333142353; numProcessing=2 2023-07-14 11:15:38,102 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,46581,1689333142353 already deleted, retry=false 2023-07-14 11:15:38,102 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,46581,1689333142353 expired; onlineServers=1 2023-07-14 11:15:38,200 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 11:15:38,200 INFO [RS:0;jenkins-hbase9:46581] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,46581,1689333142353; zookeeper connection closed. 2023-07-14 11:15:38,200 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:46581-0x101637acd0d0001, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 11:15:38,200 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@42273811] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@42273811 2023-07-14 11:15:38,224 INFO [RS:2;jenkins-hbase9:40207] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,40207,1689333142617; all regions closed. 2023-07-14 11:15:38,231 DEBUG [RS:2;jenkins-hbase9:40207] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/oldWALs 2023-07-14 11:15:38,231 INFO [RS:2;jenkins-hbase9:40207] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C40207%2C1689333142617.meta:.meta(num 1689333146009) 2023-07-14 11:15:38,242 DEBUG [RS:2;jenkins-hbase9:40207] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/oldWALs 2023-07-14 11:15:38,242 INFO [RS:2;jenkins-hbase9:40207] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase9.apache.org%2C40207%2C1689333142617:(num 1689333145639) 2023-07-14 11:15:38,242 DEBUG [RS:2;jenkins-hbase9:40207] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:15:38,242 INFO [RS:2;jenkins-hbase9:40207] regionserver.LeaseManager(133): Closed leases 2023-07-14 11:15:38,243 INFO [RS:2;jenkins-hbase9:40207] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase9:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-14 11:15:38,243 INFO [regionserver/jenkins-hbase9:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 11:15:38,243 INFO [RS:2;jenkins-hbase9:40207] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:40207 2023-07-14 11:15:38,245 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase9.apache.org,40207,1689333142617 2023-07-14 11:15:38,246 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-14 11:15:38,247 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase9.apache.org,40207,1689333142617] 2023-07-14 11:15:38,247 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase9.apache.org,40207,1689333142617; numProcessing=3 2023-07-14 11:15:38,248 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase9.apache.org,40207,1689333142617 already deleted, retry=false 2023-07-14 11:15:38,248 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase9.apache.org,40207,1689333142617 expired; onlineServers=0 2023-07-14 11:15:38,248 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase9.apache.org,38311,1689333140751' ***** 2023-07-14 11:15:38,248 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-14 11:15:38,248 DEBUG [M:0;jenkins-hbase9:38311] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@750f5fe5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase9.apache.org/172.31.2.10:0 2023-07-14 11:15:38,248 INFO [M:0;jenkins-hbase9:38311] regionserver.HRegionServer(1144): stopping server jenkins-hbase9.apache.org,38311,1689333140751 2023-07-14 11:15:38,248 INFO [M:0;jenkins-hbase9:38311] regionserver.HRegionServer(1170): stopping server jenkins-hbase9.apache.org,38311,1689333140751; all regions closed. 2023-07-14 11:15:38,248 DEBUG [M:0;jenkins-hbase9:38311] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-14 11:15:38,249 DEBUG [M:0;jenkins-hbase9:38311] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-14 11:15:38,249 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-14 11:15:38,249 DEBUG [M:0;jenkins-hbase9:38311] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-14 11:15:38,249 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689333145013] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.small.0-1689333145013,5,FailOnTimeoutGroup] 2023-07-14 11:15:38,249 DEBUG [master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689333145013] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase9:0:becomeActiveMaster-HFileCleaner.large.0-1689333145013,5,FailOnTimeoutGroup] 2023-07-14 11:15:38,249 INFO [M:0;jenkins-hbase9:38311] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-14 11:15:38,249 INFO [M:0;jenkins-hbase9:38311] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-14 11:15:38,249 INFO [M:0;jenkins-hbase9:38311] hbase.ChoreService(369): Chore service for: master/jenkins-hbase9:0 had [] on shutdown 2023-07-14 11:15:38,249 DEBUG [M:0;jenkins-hbase9:38311] master.HMaster(1512): Stopping service threads 2023-07-14 11:15:38,249 INFO [M:0;jenkins-hbase9:38311] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-14 11:15:38,250 ERROR [M:0;jenkins-hbase9:38311] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-27,5,PEWorkerGroup] Thread[HFileArchiver-28,5,PEWorkerGroup] 2023-07-14 11:15:38,250 INFO [M:0;jenkins-hbase9:38311] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-14 11:15:38,250 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-14 11:15:38,251 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-14 11:15:38,251 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-14 11:15:38,251 DEBUG [M:0;jenkins-hbase9:38311] zookeeper.ZKUtil(398): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-14 11:15:38,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-14 11:15:38,251 WARN [M:0;jenkins-hbase9:38311] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-14 11:15:38,251 INFO [M:0;jenkins-hbase9:38311] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-14 11:15:38,251 INFO [M:0;jenkins-hbase9:38311] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-14 11:15:38,252 DEBUG [M:0;jenkins-hbase9:38311] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-14 11:15:38,252 INFO [M:0;jenkins-hbase9:38311] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 11:15:38,252 DEBUG [M:0;jenkins-hbase9:38311] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 11:15:38,252 DEBUG [M:0;jenkins-hbase9:38311] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-14 11:15:38,252 DEBUG [M:0;jenkins-hbase9:38311] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 11:15:38,252 INFO [M:0;jenkins-hbase9:38311] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.38 KB heapSize=449.61 KB 2023-07-14 11:15:38,270 INFO [M:0;jenkins-hbase9:38311] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.38 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/29c7dd524c8b47c59e2152621c251f5e 2023-07-14 11:15:38,274 INFO [M:0;jenkins-hbase9:38311] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 29c7dd524c8b47c59e2152621c251f5e 2023-07-14 11:15:38,275 DEBUG [M:0;jenkins-hbase9:38311] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/29c7dd524c8b47c59e2152621c251f5e as hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/29c7dd524c8b47c59e2152621c251f5e 2023-07-14 11:15:38,279 INFO [M:0;jenkins-hbase9:38311] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 29c7dd524c8b47c59e2152621c251f5e 2023-07-14 11:15:38,279 INFO [M:0;jenkins-hbase9:38311] regionserver.HStore(1080): Added hdfs://localhost:36847/user/jenkins/test-data/d9edc76d-d5dd-bf55-c5b6-9ee49ede54f4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/29c7dd524c8b47c59e2152621c251f5e, entries=119, sequenceid=899, filesize=28.4 K 2023-07-14 11:15:38,280 INFO [M:0;jenkins-hbase9:38311] regionserver.HRegion(2948): Finished flush of dataSize ~373.38 KB/382337, heapSize ~449.59 KB/460384, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 28ms, sequenceid=899, compaction requested=false 2023-07-14 11:15:38,282 INFO [M:0;jenkins-hbase9:38311] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-14 11:15:38,282 DEBUG [M:0;jenkins-hbase9:38311] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-14 11:15:38,296 INFO [M:0;jenkins-hbase9:38311] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-14 11:15:38,297 INFO [M:0;jenkins-hbase9:38311] ipc.NettyRpcServer(158): Stopping server on /172.31.2.10:38311 2023-07-14 11:15:38,297 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-14 11:15:38,300 DEBUG [M:0;jenkins-hbase9:38311] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase9.apache.org,38311,1689333140751 already deleted, retry=false 2023-07-14 11:15:38,347 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 11:15:38,347 INFO [RS:2;jenkins-hbase9:40207] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,40207,1689333142617; zookeeper connection closed. 2023-07-14 11:15:38,347 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): regionserver:40207-0x101637acd0d0003, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 11:15:38,350 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@5f553f0b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@5f553f0b 2023-07-14 11:15:38,350 INFO [Listener at jenkins-hbase9.apache.org/36907] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-14 11:15:38,402 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 11:15:38,402 INFO [M:0;jenkins-hbase9:38311] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase9.apache.org,38311,1689333140751; zookeeper connection closed. 2023-07-14 11:15:38,402 DEBUG [Listener at localhost/39195-EventThread] zookeeper.ZKWatcher(600): master:38311-0x101637acd0d0000, quorum=127.0.0.1:58300, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-14 11:15:38,404 WARN [Listener at jenkins-hbase9.apache.org/36907] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 11:15:38,420 INFO [Listener at jenkins-hbase9.apache.org/36907] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 11:15:38,524 WARN [BP-634024319-172.31.2.10-1689333136763 heartbeating to localhost/127.0.0.1:36847] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 11:15:38,524 WARN [BP-634024319-172.31.2.10-1689333136763 heartbeating to localhost/127.0.0.1:36847] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-634024319-172.31.2.10-1689333136763 (Datanode Uuid d3f89d4c-16c2-4824-812b-6b7388609af1) service to localhost/127.0.0.1:36847 2023-07-14 11:15:38,526 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/cluster_2a4290d5-6584-4b86-320b-63166dfccd9d/dfs/data/data5/current/BP-634024319-172.31.2.10-1689333136763] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 11:15:38,526 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/cluster_2a4290d5-6584-4b86-320b-63166dfccd9d/dfs/data/data6/current/BP-634024319-172.31.2.10-1689333136763] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 11:15:38,553 WARN [Listener at jenkins-hbase9.apache.org/36907] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 11:15:38,562 INFO [Listener at jenkins-hbase9.apache.org/36907] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 11:15:38,666 WARN [BP-634024319-172.31.2.10-1689333136763 heartbeating to localhost/127.0.0.1:36847] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 11:15:38,666 WARN [BP-634024319-172.31.2.10-1689333136763 heartbeating to localhost/127.0.0.1:36847] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-634024319-172.31.2.10-1689333136763 (Datanode Uuid bfbda527-4076-464f-9c99-e51a02fba6f4) service to localhost/127.0.0.1:36847 2023-07-14 11:15:38,667 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/cluster_2a4290d5-6584-4b86-320b-63166dfccd9d/dfs/data/data3/current/BP-634024319-172.31.2.10-1689333136763] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 11:15:38,667 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/cluster_2a4290d5-6584-4b86-320b-63166dfccd9d/dfs/data/data4/current/BP-634024319-172.31.2.10-1689333136763] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 11:15:38,669 WARN [Listener at jenkins-hbase9.apache.org/36907] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-14 11:15:38,676 INFO [Listener at jenkins-hbase9.apache.org/36907] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 11:15:38,678 WARN [BP-634024319-172.31.2.10-1689333136763 heartbeating to localhost/127.0.0.1:36847] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-14 11:15:38,679 WARN [BP-634024319-172.31.2.10-1689333136763 heartbeating to localhost/127.0.0.1:36847] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-634024319-172.31.2.10-1689333136763 (Datanode Uuid f1551f54-5779-4f53-8d7f-224403ad4922) service to localhost/127.0.0.1:36847 2023-07-14 11:15:38,679 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/cluster_2a4290d5-6584-4b86-320b-63166dfccd9d/dfs/data/data1/current/BP-634024319-172.31.2.10-1689333136763] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 11:15:38,679 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/4cf7ca62-83bd-688c-9c37-62df144a5c71/cluster_2a4290d5-6584-4b86-320b-63166dfccd9d/dfs/data/data2/current/BP-634024319-172.31.2.10-1689333136763] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-14 11:15:38,707 INFO [Listener at jenkins-hbase9.apache.org/36907] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-14 11:15:38,739 INFO [Listener at jenkins-hbase9.apache.org/36907] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-14 11:15:38,843 INFO [Listener at jenkins-hbase9.apache.org/36907] hbase.HBaseTestingUtility(1293): Minicluster is down